-- Logs begin at Wed 2022-10-26 10:28:04 UTC, end at Wed 2022-10-26 11:43:43 UTC. -- Oct 26 11:09:22.412159 dv-cinder-815582-18-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 26 11:09:22.420821 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 26 11:09:22.422775 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 26 11:09:22 2022] *** Oct 26 11:09:22.422775 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 26 11:09:22.422775 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 26 11:09:22.422775 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: nodename: dv-cinder-815582-18-iscsi Oct 26 11:09:22.422775 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: machine: x86_64 Oct 26 11:09:22.422775 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: clock source: unix Oct 26 11:09:22.422775 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: pcre jit disabled Oct 26 11:09:22.422775 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: detected number of CPU cores: 4 Oct 26 11:09:22.422775 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: current working directory: / Oct 26 11:09:22.422775 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: detected binary path: /usr/bin/uwsgi-core Oct 26 11:09:22.423519 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: your processes number limit is 47680 Oct 26 11:09:22.423519 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: your memory page size is 4096 bytes Oct 26 11:09:22.423519 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: detected max file descriptor number: 2048 Oct 26 11:09:22.423519 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: lock engine: pthread robust mutexes Oct 26 11:09:22.423519 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: thunder lock: enabled Oct 26 11:09:22.423519 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 26 11:09:22.423519 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 26 11:09:22.461418 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: Python main interpreter initialized at 0x5587ab3dd9c0 Oct 26 11:09:22.461418 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: python threads support enabled Oct 26 11:09:22.461418 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: your server socket listen backlog is limited to 100 connections Oct 26 11:09:22.461418 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: your mercy for graceful operations on workers is 90 seconds Oct 26 11:09:22.461751 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: mapped 403077 bytes (393 KB) for 2 cores Oct 26 11:09:22.461836 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: *** Operational MODE: preforking *** Oct 26 11:09:22.462066 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: *** uWSGI is running in multiple interpreter mode *** Oct 26 11:09:22.462066 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: spawned uWSGI master process (pid: 104254) Oct 26 11:09:22.462243 dv-cinder-815582-18-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 26 11:09:22.464431 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: spawned uWSGI worker 1 (pid: 104255, cores: 1) Oct 26 11:09:22.464431 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: spawned uWSGI worker 2 (pid: 104256, cores: 1) Oct 26 11:09:22.464431 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 26 11:09:23.112319 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 26 11:09:23.118471 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 26 11:09:24.176322 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 26 11:09:24.176322 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: from cryptography.utils import int_from_bytes Oct 26 11:09:24.176893 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 26 11:09:24.176893 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: from cryptography.utils import int_from_bytes Oct 26 11:09:24.179975 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 26 11:09:24.179975 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: from cryptography.utils import int_from_bytes Oct 26 11:09:24.180426 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 26 11:09:24.180426 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: from cryptography.utils import int_from_bytes Oct 26 11:09:26.655561 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 26 11:09:26.656117 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 26 11:09:26.656349 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 26 11:09:26.656711 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 26 11:09:26.656964 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 26 11:09:26.657349 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.657671 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.657986 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.658923 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 26 11:09:26.659320 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 26 11:09:26.659414 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.659414 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.659593 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 26 11:09:26.659706 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.659987 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 26 11:09:26.660093 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.660245 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 26 11:09:26.660333 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.660627 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.660716 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.660886 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.660981 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.661196 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.661282 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.661514 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-18-iscsi {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.661609 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.661833 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.661919 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.662140 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.662226 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.662447 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.662547 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.662761 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.662882 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.663102 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.663187 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.663384 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.663475 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.663701 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.663786 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.664030 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-18-iscsi {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.664187 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.664348 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.664641 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.664755 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.664945 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.665038 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.665253 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.665344 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.665557 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.665654 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.665879 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.665982 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.666181 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.666267 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.666497 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.666677 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.666784 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.667100 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.667196 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.667413 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.667501 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.667728 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.667886 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-18-iscsi {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.668067 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.668200 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.668382 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.668511 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.668692 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.668819 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.669014 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.669224 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.669318 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.669536 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.669636 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.669843 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.669929 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.670160 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.670326 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-18-iscsi {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.670488 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.670646 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.670794 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.670986 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.671155 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.671285 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.671475 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.671703 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.671822 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.672047 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.672148 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.672359 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.672459 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.672669 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.672768 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.672973 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.673062 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.673287 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.673391 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.673590 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.673688 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.673999 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.674603 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.674878 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.674970 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.675222 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.675311 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.675531 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.675628 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.675846 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.676053 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.676145 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.676213 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.676433 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.676524 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.676687 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.676787 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.677008 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.677098 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.677294 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.677437 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.677603 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.677754 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.677914 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.678075 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.678220 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.678362 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.678497 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.678639 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.678783 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.678969 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.679117 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.679255 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.679406 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.679543 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.679677 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.679823 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.679958 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.680100 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.680242 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.680377 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.680550 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.680734 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.680873 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.681014 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.681165 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.681301 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.681435 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.681568 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.681740 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.681890 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.682033 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.682174 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.682353 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.682501 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.682669 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.682994 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.683141 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.683277 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.683412 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.683566 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.683707 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.683865 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.684002 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.684134 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.684276 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.684411 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.684545 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.684754 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.684891 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.685026 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.685160 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.685295 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.685438 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.685581 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.685725 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.685860 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.686001 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.686136 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.686280 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.686416 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.686550 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.686684 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.686843 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.686994 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.687147 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.687283 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.687441 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.687622 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.687764 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.687931 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.688081 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.688223 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.688358 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.688499 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.688640 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.688774 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.688921 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.689057 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.689197 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.689357 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.689517 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.689667 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.689802 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.689937 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.690081 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.690216 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.690351 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.690493 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.690630 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.690831 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.690977 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.691136 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.691288 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.691435 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.691573 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.691729 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.691879 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.692014 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.692155 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.692298 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.692433 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.692617 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.692765 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.692921 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.693063 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.693215 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.693350 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.693525 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.693673 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.693830 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.693971 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.694135 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.694278 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.694448 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.694591 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.694736 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.694908 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.695061 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.695208 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.695366 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.695508 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.695664 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.695814 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.695958 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.696093 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.696264 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.696406 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.696567 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.696717 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.696853 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.696998 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.697153 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.697295 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.697453 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.697603 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.697739 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.697875 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.698038 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.698180 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.698320 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.698463 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.698620 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.698762 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.698948 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.699086 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.699221 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.699364 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.699540 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.699690 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.699831 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.699967 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.700131 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.700274 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.700430 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.700572 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.700744 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.700931 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.701084 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.701221 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.701387 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.701537 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.701697 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.701851 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.702019 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.702162 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.702342 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.702497 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.702654 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.702795 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.702983 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.703128 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.703291 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.703434 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.703597 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.703745 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:09:26.703918 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.704059 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.704231 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.704373 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.704537 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.704691 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.704843 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.704979 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.705135 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.705278 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.705440 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.705590 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.705765 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.705907 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.706078 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.706220 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.706389 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.706538 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.706756 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.706958 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.707097 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.707238 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.707382 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.707527 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.707662 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.707796 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.707930 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.708071 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.708212 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.708357 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.708543 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.708696 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.708885 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.709028 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.709194 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.709336 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.709513 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.709656 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.709829 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.709971 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.710136 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.710290 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.710426 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.710568 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.710734 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.710948 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.711107 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.711253 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.711389 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.711525 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.711660 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.711795 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.711973 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.712121 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.712280 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.712422 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.712598 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.712767 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.712904 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.713046 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.713180 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.713315 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.713488 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.713645 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.713782 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.713945 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.714147 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.714295 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.714431 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.714575 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.714723 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.714954 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.715098 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.715244 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.715380 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.715523 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.715666 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.715803 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.715938 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.716100 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.716251 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.716399 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.716553 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.716712 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.716855 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.717029 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.717183 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.717350 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.717500 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.717643 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.717790 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.717935 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.718078 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.718214 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.718348 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.718515 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.718658 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.718855 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.719015 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.719152 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.719286 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.719473 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.719616 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.719774 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.719932 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.720069 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.720204 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.720370 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.720523 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.720671 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.721349 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.721491 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.721626 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.721761 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.721897 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.722042 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.722179 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.722323 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.722461 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.722624 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.722767 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.722982 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.723122 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.723258 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.723393 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.723528 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.723662 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.723808 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.723944 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.724117 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.724270 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.724428 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.724579 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.724736 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.724901 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.725042 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.725177 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.725333 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.725485 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.725642 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.725786 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.725960 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.726102 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.726268 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.726420 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.726556 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.726706 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.726910 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.727054 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.727236 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.727389 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.727526 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.727661 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.727840 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.727982 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.728149 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.728301 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.728438 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.728571 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.728723 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.728859 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.729027 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.729170 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.729328 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.729476 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.729619 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.729754 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.729898 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.730033 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.730180 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.730315 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.730478 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.730630 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.730774 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.730948 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.731153 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.731295 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.731471 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.731622 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.731759 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.731899 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.732035 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.732177 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.732312 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.732466 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.732610 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.732752 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.732930 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.733067 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.733202 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.733411 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.733550 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.733686 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.733827 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.733972 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.734109 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.734255 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.734401 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.734537 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.734713 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.734878 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.735056 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.735205 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.735364 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.735507 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.735672 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.735813 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.735962 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.736105 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.736248 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.736457 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.737153 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.737310 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.737462 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.737605 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.737747 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.737894 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.738036 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.738200 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.738360 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.738514 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.738657 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.738864 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.739040 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.739200 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.739345 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.739485 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.739626 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.739766 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.739908 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.740057 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.740199 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.740363 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.740519 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.740663 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.740813 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.740976 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.741120 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.741262 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.741403 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.741588 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.741741 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.741897 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.742041 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.742189 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.742338 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.742481 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.742630 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.742791 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.742958 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.743102 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.743244 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.743420 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.743581 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.743724 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.743864 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.744006 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.744153 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.744296 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.744446 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.745136 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.745305 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.745449 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.745590 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.745740 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.746148 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.746297 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.746440 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.746624 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.746766 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.746989 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.747145 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.747288 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.747451 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.747601 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.747756 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.747899 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.748040 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.748190 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.748334 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.748474 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.748623 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.748766 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.748907 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.749047 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.749189 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.749341 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.749491 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.749633 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.749781 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.749924 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.750065 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.750206 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.750357 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.750499 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.750640 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.750781 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.750965 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.751118 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.751271 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.751413 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.751413 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.751732 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.751880 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.752059 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.752213 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.752356 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.752498 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.752650 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.752801 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.752952 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.753094 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.753246 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.753388 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.753530 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.753671 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.753824 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.753966 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.754107 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.754249 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.754398 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.754542 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.754691 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.754850 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.754999 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.755161 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.755315 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.755466 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.755615 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.755759 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.755900 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.756040 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.756181 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.756331 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.756473 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.756615 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.756762 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.756915 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.757056 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.757205 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.757347 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.757488 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.757629 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.757770 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.757909 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.758063 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.758212 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.758354 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.758494 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.758635 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.758798 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.758975 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.759117 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.759273 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.759417 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.759557 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.759706 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.759850 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.759993 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.760133 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.760274 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.760415 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.760563 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.760715 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.760857 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.760997 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.761138 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.761278 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.761427 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.761570 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.761570 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.761883 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.762025 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.762240 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.762385 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.762526 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.762526 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.762805 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.763046 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.763208 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.763357 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.763512 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.763654 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.763794 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.763936 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.764086 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.764237 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.764388 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.764544 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.764686 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.764827 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.764968 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.765117 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.765266 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.765411 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.765552 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.765692 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.765833 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.765986 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.766130 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.766271 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.766422 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.766422 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.766702 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.766887 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.767049 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.767193 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.767341 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.767483 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.768150 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.768301 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.768443 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.768598 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.768749 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.768902 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.769050 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.769207 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.769350 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.769491 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.769631 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.769778 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.769920 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.770069 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.770069 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.770347 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.770488 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.770639 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.770781 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.770978 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.771132 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.771276 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.771417 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.771565 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.771708 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.771898 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.772048 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.772189 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.772332 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.772474 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.772638 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.772782 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.772931 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.773073 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.773215 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.773357 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.773507 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.773650 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.773792 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.773933 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.774074 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.774215 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.774364 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.774518 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.774661 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.774802 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.774979 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.775123 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.775273 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.775415 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.775564 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.775707 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.775864 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.776018 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.776161 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.776303 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.776454 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.776597 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.776739 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.776888 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.777031 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.777178 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.777321 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.777461 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.777610 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.777765 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.777909 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.778050 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.778202 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.778343 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.778493 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.778637 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.778779 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.778986 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.779131 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.779279 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.779433 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.779576 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.779719 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.779860 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.780001 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.780152 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.780306 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.780455 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.780597 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.780746 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.780889 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.781040 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.781191 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.781191 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.781460 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.781601 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.781743 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.781925 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.782092 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.782236 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.782377 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.782518 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.782659 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.782808 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.782984 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.783126 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.783313 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.783954 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.784097 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.784251 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.784394 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.784545 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.784688 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.784829 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.784972 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.785121 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.785265 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.785414 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.785557 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.785698 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.785848 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.786066 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.786218 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.786372 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.786514 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.786655 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.786805 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.786978 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.787121 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.787262 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.787403 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.787544 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.787698 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.787840 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.787982 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.788124 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.788285 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.788428 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.788579 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.788721 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.788863 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.789004 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.789146 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.789287 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.789445 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.789588 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.789736 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.789878 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.790019 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.790179 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.790323 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.790464 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.790605 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.790746 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.790914 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.791069 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.791214 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.791355 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.791507 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.791656 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.791797 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.791987 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.792149 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.792291 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.792432 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.792573 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.792713 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.792862 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.793005 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.793145 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.793293 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.793435 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.793584 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.793726 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.793867 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.794028 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.794171 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.794312 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.794462 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.794605 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.794746 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.794935 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.795080 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.795222 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.795371 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.795515 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.795656 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.795806 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.795958 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.796100 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.796250 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.796392 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.796392 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.796669 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.796811 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.796960 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.797102 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.797253 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.797402 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.797545 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.797696 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.797851 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.798001 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.798143 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.798285 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.798426 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.798568 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.798726 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.798933 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.799086 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.799238 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.799382 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.799523 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.799685 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.799833 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.799982 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.800126 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.800267 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.800421 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.800563 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.800705 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.800846 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.800987 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.801141 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.801292 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.801434 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.801586 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.801729 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.801871 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.802012 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.802207 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.802352 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.802501 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.802642 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.802785 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.802959 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.803081 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.803168 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.803250 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.803330 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.803410 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.803504 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.803592 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.803679 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.803768 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.803849 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.803999 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.804139 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.804304 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.804453 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.804608 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.804766 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.804913 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.805074 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.805222 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.805385 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.805528 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.805695 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.805827 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.806001 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.806234 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.806323 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.806541 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.806629 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.806874 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.806972 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.807180 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.807279 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.807477 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.807564 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.807773 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.807862 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.808076 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.808163 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.808398 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.808571 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.808725 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.808880 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.809023 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.809176 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.809318 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.809459 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.809612 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.809761 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.809903 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.810046 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.810194 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.810344 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.810526 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.810685 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.810851 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.811001 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.811144 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.811365 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.811523 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.811667 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.811808 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.811950 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.812092 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.812284 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.812438 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.812587 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.812740 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.812888 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.813030 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.813253 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.813398 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.813540 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.813682 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.813836 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.813991 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.814134 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.814277 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.814424 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.814606 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.814785 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.815090 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.815241 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.815386 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.815535 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.815685 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.815828 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.815976 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.816126 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.816277 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.816428 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.816570 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.816570 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.816850 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.817018 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.817173 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.817317 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.817466 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.817609 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.817757 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.817906 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.818060 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.818203 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.818344 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.818487 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.818645 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.818797 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.818961 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.819120 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.819268 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.819410 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.819552 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.819707 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.819851 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.819993 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.820135 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.820283 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.820426 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.820590 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.820742 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.820886 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.821027 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.821170 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.821311 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.821464 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.821610 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.821752 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.821893 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.822042 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.822235 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.822387 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.822546 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.822691 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.822859 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.823009 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.823228 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.823373 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.823373 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.823642 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.823785 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.823926 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.824080 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.824232 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.824386 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.824528 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.824670 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.824819 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.824970 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.825119 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.825262 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.825413 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.825556 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.825712 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.825862 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.826004 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.826146 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.826299 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.826441 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.826590 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.826590 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.826877 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.827027 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.827170 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.827311 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.827464 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.827608 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.827750 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.827893 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.828035 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.828194 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.828346 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.828488 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.828630 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.828771 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.828912 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.829070 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.829223 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.829366 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.829514 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.829658 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.829799 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.829958 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.830613 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.830765 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.830951 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.831097 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.831239 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.831393 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.831536 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.831679 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.831820 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.831970 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.832114 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.832264 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.832469 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.832613 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.832754 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.832904 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.833055 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.833199 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.833341 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.833483 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.833624 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.833765 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.833916 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.834059 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.834202 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.834359 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.834503 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.834646 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.834799 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.834976 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.835119 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.835261 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.835404 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.835546 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.835702 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.835858 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.836001 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.836148 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.836302 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.836453 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.836598 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.836739 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.836881 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.837022 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.837165 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.837315 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.837459 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.837607 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.837750 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.837891 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.838033 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.838204 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.838349 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.838491 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.838633 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.838781 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.838984 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.839140 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.839284 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.839426 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.839575 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.839728 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.839880 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.840035 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.840178 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.840320 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.840462 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.840604 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.840754 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.840897 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.841045 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.841194 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.841343 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.841487 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.841637 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.841781 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.841933 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.842082 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.842224 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.842404 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.842563 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.842708 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.842871 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.843029 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.843181 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.843332 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.843476 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.843619 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.843771 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.843920 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.844063 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.844214 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.844356 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.844508 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.844652 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.844802 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.844986 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.845150 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.845301 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.845444 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.845596 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.845759 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.846427 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.846606 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.846753 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.846939 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.847094 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.847244 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.847396 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.847546 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.847688 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.847838 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.847982 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.848135 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.848285 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.848435 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.848578 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.848727 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.848871 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.849020 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.849163 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.849351 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.849500 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.849671 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.849829 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.849993 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.850137 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.850281 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.850423 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.850590 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.850752 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.850953 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.851098 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.851241 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.851382 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.851585 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.851811 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.851968 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.852112 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.852254 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.852396 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.852578 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.852734 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.852878 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.853020 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.853162 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.853304 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.853454 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.853596 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.853748 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.853890 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.854031 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.854179 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.854331 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.854475 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.854616 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.854759 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.854918 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.855011 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.855204 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.855297 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.855521 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.855611 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.855839 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.855937 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.856138 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.856229 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.856454 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.856551 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.856757 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.856860 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.857074 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.857281 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.857435 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.857621 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.857894 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.858053 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.858203 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.858349 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.858535 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.858683 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.858873 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.859038 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.859190 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.859333 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.859476 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.859617 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.859782 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.859937 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.860080 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.860221 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.860363 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.860505 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.860655 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.860798 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.860947 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.861090 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.861231 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.861394 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.862038 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.862197 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.862340 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.862483 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.862672 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.862855 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.863018 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.863162 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.863305 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.863446 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.863589 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.863738 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.863882 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.864034 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.864175 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.864324 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.864467 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.864618 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.864791 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.864947 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.865118 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.865275 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.865445 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.865600 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.865745 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.865887 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.866039 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.866180 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.866322 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.866476 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.866626 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.866776 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.866951 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.867094 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.867248 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.867391 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.867539 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.867681 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.867825 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.867977 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.868127 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.868271 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.868412 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.868554 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.868696 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.868839 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.868988 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.869130 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.869272 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.869414 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.869555 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.869696 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.869857 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.870007 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.870150 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.870291 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.870440 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.870592 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.870741 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.871178 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.871322 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.871464 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.871689 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.871848 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.872010 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.872164 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.872308 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.872449 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.872592 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.872784 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.872932 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.873075 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.873216 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.873358 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.873499 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.873649 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.873792 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.873943 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.874086 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.874228 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.874378 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.874521 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.874663 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.874804 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.875011 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.875166 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.875322 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.875465 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.875606 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.875749 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.875909 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.876053 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.876208 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.876359 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.876502 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.876644 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.876792 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.876943 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.877637 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.877793 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.877937 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.878078 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.878232 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.878383 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.878534 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.878677 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.878849 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.879083 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.879234 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.879420 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.879572 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.879744 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.879893 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.880066 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.880213 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.880381 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.880525 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.880673 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.880816 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.880967 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.881188 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.881333 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.881477 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.881619 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.881767 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.881910 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.882060 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.882215 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.882370 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.882514 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.882657 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.882899 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.883072 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.883216 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.883359 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.883508 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.883673 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.883831 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.883974 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.884115 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.884267 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.884409 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.884551 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.884701 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.884851 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.885002 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.885152 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.885294 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.885436 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.885591 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.885735 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.885885 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.886038 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.886181 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.886361 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.886511 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.886683 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.886865 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.887030 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.887174 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.887331 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.887481 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.887623 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.887765 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.887908 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.888063 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.888214 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.888357 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.888498 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.888639 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.888811 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.888968 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.889120 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.889262 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.889403 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.889543 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.889694 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.889855 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.889999 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.890141 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.890282 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.890546 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.890694 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.890897 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.891081 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.891243 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.891410 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.891559 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.891727 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.891883 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.892043 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.892186 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.892334 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.892480 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.892654 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.892802 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.892996 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.893143 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.893285 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.893427 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.893577 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.893721 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.893873 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.894016 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.894165 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.894314 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.894465 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.894609 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.894750 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.894922 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.895014 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.895184 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.895291 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.895494 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.895585 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.895800 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.895889 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.896116 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.896207 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.896436 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.896526 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.896742 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.896832 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.897045 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.897135 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.897349 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.897436 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.897658 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.897745 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.897983 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.898080 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.898272 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.898367 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.898573 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.898669 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.898903 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.899010 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.899210 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.899312 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.899511 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.899621 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.899813 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.899903 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.900115 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.900203 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.900414 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.900510 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.900716 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.900803 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.901016 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.901112 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.901327 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.901425 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.901629 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.901715 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.901932 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.902027 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.902235 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.902330 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.902537 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.902633 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.902872 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.903084 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.903243 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.903396 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.903550 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.903693 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.903835 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.903984 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.904139 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.904290 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.904434 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.904576 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.904726 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.904878 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.905022 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.905164 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.905312 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.905466 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.905651 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.905812 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.905969 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.906114 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.906256 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.906397 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.906540 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.906692 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.906893 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.907046 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.907189 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.907342 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.907492 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.907652 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.907796 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.907960 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.908134 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.908302 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.908459 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.908603 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.908746 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.908897 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.909040 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.909182 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.909437 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.909589 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.909733 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.909874 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.910016 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.910159 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.910310 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.910460 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.910610 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 26 11:09:26.910755 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.910928 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.911130 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.911442 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.911752 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.912059 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.912367 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.912675 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.912988 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.913296 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.913611 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.913925 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.914239 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.914562 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.914914 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.915226 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.915551 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.915875 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.916220 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.916535 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.916882 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.917213 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.917528 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.917845 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.918156 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:09:26.918402 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 26 11:09:27.062963 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO dbcounter [None req-8e737abc-210c-475c-b33c-5f514f5ffdc3 None None] Registered counter for database nova_api Oct 26 11:09:27.071337 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO dbcounter [None req-ae9a2619-e57c-46e6-ae4c-5de1c9a00d0e None None] Registered counter for database nova_api Oct 26 11:09:27.083953 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_db.sqlalchemy.engines [None req-8e737abc-210c-475c-b33c-5f514f5ffdc3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 11:09:27.090550 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG dbcounter [-] [104256] Writer thread running {{(pid=104256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 11:09:27.090985 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG oslo_db.sqlalchemy.engines [None req-ae9a2619-e57c-46e6-ae4c-5de1c9a00d0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104255) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 11:09:27.097482 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG dbcounter [-] [104255] Writer thread running {{(pid=104255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 11:09:27.147845 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.context [None req-8e737abc-210c-475c-b33c-5f514f5ffdc3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7411e83a-2967-480a-988d-f63e6d8f34bf(cell1) {{(pid=104256) load_cells /opt/stack/nova/nova/context.py:464}} Oct 26 11:09:27.151749 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_concurrency.lockutils [None req-8e737abc-210c-475c-b33c-5f514f5ffdc3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:09:27.152218 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_concurrency.lockutils [None req-8e737abc-210c-475c-b33c-5f514f5ffdc3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:09:27.153806 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_concurrency.lockutils [None req-8e737abc-210c-475c-b33c-5f514f5ffdc3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:09:27.154541 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_concurrency.lockutils [None req-8e737abc-210c-475c-b33c-5f514f5ffdc3 None None] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:09:27.154962 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_concurrency.lockutils [None req-8e737abc-210c-475c-b33c-5f514f5ffdc3 None None] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:09:27.155092 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.context [None req-ae9a2619-e57c-46e6-ae4c-5de1c9a00d0e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7411e83a-2967-480a-988d-f63e6d8f34bf(cell1) {{(pid=104255) load_cells /opt/stack/nova/nova/context.py:464}} Oct 26 11:09:27.156974 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_concurrency.lockutils [None req-8e737abc-210c-475c-b33c-5f514f5ffdc3 None None] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:09:27.159466 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO dbcounter [None req-8e737abc-210c-475c-b33c-5f514f5ffdc3 None None] Registered counter for database nova_cell0 Oct 26 11:09:27.159571 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-ae9a2619-e57c-46e6-ae4c-5de1c9a00d0e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:09:27.159980 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-ae9a2619-e57c-46e6-ae4c-5de1c9a00d0e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:09:27.161580 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-ae9a2619-e57c-46e6-ae4c-5de1c9a00d0e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:09:27.162386 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-ae9a2619-e57c-46e6-ae4c-5de1c9a00d0e None None] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:09:27.162856 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-ae9a2619-e57c-46e6-ae4c-5de1c9a00d0e None None] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:09:27.163495 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO dbcounter [None req-8e737abc-210c-475c-b33c-5f514f5ffdc3 None None] Registered counter for database nova_cell1 Oct 26 11:09:27.164857 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG oslo_concurrency.lockutils [None req-ae9a2619-e57c-46e6-ae4c-5de1c9a00d0e None None] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:09:27.166954 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO dbcounter [None req-ae9a2619-e57c-46e6-ae4c-5de1c9a00d0e None None] Registered counter for database nova_cell0 Oct 26 11:09:27.170844 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_db.sqlalchemy.engines [None req-8e737abc-210c-475c-b33c-5f514f5ffdc3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 11:09:27.171234 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO dbcounter [None req-ae9a2619-e57c-46e6-ae4c-5de1c9a00d0e None None] Registered counter for database nova_cell1 Oct 26 11:09:27.173277 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_db.sqlalchemy.engines [None req-8e737abc-210c-475c-b33c-5f514f5ffdc3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 11:09:27.178564 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG dbcounter [-] [104256] Writer thread running {{(pid=104256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 11:09:27.179258 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG oslo_db.sqlalchemy.engines [None req-ae9a2619-e57c-46e6-ae4c-5de1c9a00d0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104255) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 11:09:27.181355 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG oslo_db.sqlalchemy.engines [None req-ae9a2619-e57c-46e6-ae4c-5de1c9a00d0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104255) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 11:09:27.182672 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG dbcounter [-] [104256] Writer thread running {{(pid=104256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 11:09:27.188521 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG dbcounter [-] [104255] Writer thread running {{(pid=104255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 11:09:27.190541 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG dbcounter [-] [104255] Writer thread running {{(pid=104255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 11:09:27.325583 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO dbcounter [None req-8e737abc-210c-475c-b33c-5f514f5ffdc3 None None] Registered counter for database nova_cell0 Oct 26 11:09:27.335008 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_db.sqlalchemy.engines [None req-8e737abc-210c-475c-b33c-5f514f5ffdc3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 11:09:27.336270 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO dbcounter [None req-ae9a2619-e57c-46e6-ae4c-5de1c9a00d0e None None] Registered counter for database nova_cell0 Oct 26 11:09:27.339833 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG dbcounter [-] [104256] Writer thread running {{(pid=104256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 11:09:27.345017 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG oslo_db.sqlalchemy.engines [None req-ae9a2619-e57c-46e6-ae4c-5de1c9a00d0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104255) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 11:09:27.349847 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG dbcounter [-] [104255] Writer thread running {{(pid=104255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 11:09:27.756759 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: WARNING keystonemiddleware.auth_token [None req-8e737abc-210c-475c-b33c-5f514f5ffdc3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 26 11:09:27.764068 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: WARNING keystonemiddleware.auth_token [None req-8e737abc-210c-475c-b33c-5f514f5ffdc3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 26 11:09:27.780125 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: WARNING keystonemiddleware.auth_token [None req-ae9a2619-e57c-46e6-ae4c-5de1c9a00d0e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 26 11:09:27.787402 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: WARNING keystonemiddleware.auth_token [None req-ae9a2619-e57c-46e6-ae4c-5de1c9a00d0e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 26 11:09:28.100267 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: WARNING keystonemiddleware.auth_token [None req-8e737abc-210c-475c-b33c-5f514f5ffdc3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 26 11:09:28.106128 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: WARNING keystonemiddleware.auth_token [None req-8e737abc-210c-475c-b33c-5f514f5ffdc3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 26 11:09:28.111431 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5587ab3dd9c0 pid: 104256 (default app) Oct 26 11:09:28.113465 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-8e737abc-210c-475c-b33c-5f514f5ffdc3 None None] Calling method '>' {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:09:28.114649 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-8e737abc-210c-475c-b33c-5f514f5ffdc3 None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001703 Oct 26 11:09:28.115084 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Wed Oct 26 11:09:28 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:09:28.125113 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: WARNING keystonemiddleware.auth_token [None req-ae9a2619-e57c-46e6-ae4c-5de1c9a00d0e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 26 11:09:28.131734 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: WARNING keystonemiddleware.auth_token [None req-ae9a2619-e57c-46e6-ae4c-5de1c9a00d0e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 26 11:09:28.137087 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5587ab3dd9c0 pid: 104255 (default app) Oct 26 11:10:51.530547 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-8e737abc-210c-475c-b33c-5f514f5ffdc3 None None] Calling method '>' {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:10:51.531692 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-8e737abc-210c-475c-b33c-5f514f5ffdc3 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Oct 26 11:10:51.532105 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 931 bytes} [Wed Oct 26 11:10:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:10:51.543946 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG dbcounter [-] [104255] Writing DB stats nova_api:SELECT=3 {{(pid=104255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:51.545071 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG dbcounter [-] [104255] Writing DB stats nova_cell0:SELECT=3 {{(pid=104255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:51.545932 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG dbcounter [-] [104255] Writing DB stats nova_cell1:SELECT=3 {{(pid=104255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:51.548200 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG dbcounter [-] [104255] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:52.434497 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-28bbe91a-8068-46ca-8c98-4505f109d00e admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:10:52.467846 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-28bbe91a-8068-46ca-8c98-4505f109d00e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.928997 Oct 26 11:10:52.468556 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1292 bytes} [Wed Oct 26 11:10:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:10:55.088301 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-8e737abc-210c-475c-b33c-5f514f5ffdc3 None None] Calling method '>' {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:10:55.089326 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-8e737abc-210c-475c-b33c-5f514f5ffdc3 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 26 11:10:55.089926 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 3/4] 10.222.0.42 () {54 vars in 931 bytes} [Wed Oct 26 11:10:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:10:55.543112 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-6786dfc4-8dbc-4e32-b18c-ad9170f40553 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "os-flavor-access:is_public": true, "swap": 0, "id": "c1", "rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "ram": 256}} {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:10:55.653114 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-6786dfc4-8dbc-4e32-b18c-ad9170f40553 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.557257 Oct 26 11:10:55.653672 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 2/5] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Oct 26 11:10:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 11:10:55.668717 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG dbcounter [-] [104256] Writing DB stats nova_api:SELECT=3 {{(pid=104256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:55.672836 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG dbcounter [-] [104256] Writing DB stats nova_cell0:SELECT=3 {{(pid=104256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:55.672836 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG dbcounter [-] [104256] Writing DB stats nova_cell1:SELECT=3 {{(pid=104256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:55.672836 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG dbcounter [-] [104256] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:10:55.875745 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-ab70ffb7-7cbc-4be1-a90c-b82a86ab96e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:10:56.016569 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-ab70ffb7-7cbc-4be1-a90c-b82a86ab96e9 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.353846 Oct 26 11:10:56.017151 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 4/6] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Oct 26 11:10:55 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:10:58.617809 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-6786dfc4-8dbc-4e32-b18c-ad9170f40553 admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:10:58.618860 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-6786dfc4-8dbc-4e32-b18c-ad9170f40553 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 26 11:10:58.621201 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 3/7] 10.222.0.42 () {54 vars in 931 bytes} [Wed Oct 26 11:10:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:10:59.271324 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-0c86dc3b-c33c-42dd-9d58-d3b7dff1496a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "vcpus": 1, "disk": 5, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "ram": 512, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:10:59.388413 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-0c86dc3b-c33c-42dd-9d58-d3b7dff1496a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.762479 Oct 26 11:10:59.389088 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 5/8] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Oct 26 11:10:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 11:10:59.404189 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-f01a4dee-a51e-407f-a671-12a8b08771e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:10:59.492570 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-f01a4dee-a51e-407f-a671-12a8b08771e3 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092110 Oct 26 11:10:59.493320 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 4/9] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Oct 26 11:10:59 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:11:02.092196 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-0c86dc3b-c33c-42dd-9d58-d3b7dff1496a admin admin] Calling method '>' {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:11:02.093171 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-0c86dc3b-c33c-42dd-9d58-d3b7dff1496a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Oct 26 11:11:02.093576 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 931 bytes} [Wed Oct 26 11:11:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:11:02.502180 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-b2b7ed61-0b79-4f7f-8245-95a0905443d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "swap": 0, "os-flavor-access:is_public": true, "id": "d2", "rxtx_factor": 1.0, "vcpus": 1, "name": "ds1G"}} {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:11:02.568091 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-b2b7ed61-0b79-4f7f-8245-95a0905443d9 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.468245 Oct 26 11:11:02.568683 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 5/11] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Oct 26 11:11:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 11:11:02.581065 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-3dcb20fd-b03b-440d-8cd5-5930ebdfe3ee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:11:02.692851 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-3dcb20fd-b03b-440d-8cd5-5930ebdfe3ee admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115454 Oct 26 11:11:02.693434 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 7/12] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Oct 26 11:11:02 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:11:05.313885 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-b2b7ed61-0b79-4f7f-8245-95a0905443d9 admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:11:05.314850 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-b2b7ed61-0b79-4f7f-8245-95a0905443d9 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Oct 26 11:11:05.315302 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 6/13] 10.222.0.42 () {54 vars in 931 bytes} [Wed Oct 26 11:11:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:11:05.733823 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-3bbb8a14-d03c-42f5-8024-5b96d974a3e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "name": "ds2G", "id": "d3", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2}} {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:11:05.819258 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-3bbb8a14-d03c-42f5-8024-5b96d974a3e6 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.497924 Oct 26 11:11:05.819988 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 8/14] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Oct 26 11:11:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 11:11:05.832421 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-f720e78c-8724-4cb7-b22a-6388aeabc02d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:11:05.892116 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-f720e78c-8724-4cb7-b22a-6388aeabc02d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063293 Oct 26 11:11:05.892753 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 7/15] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Oct 26 11:11:05 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:11:08.499972 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-3bbb8a14-d03c-42f5-8024-5b96d974a3e6 admin admin] Calling method '>' {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:11:08.500906 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-3bbb8a14-d03c-42f5-8024-5b96d974a3e6 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Oct 26 11:11:08.501302 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 9/16] 10.222.0.42 () {54 vars in 931 bytes} [Wed Oct 26 11:11:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:11:08.927183 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-e677f49a-a94b-41f1-aaac-f6ae7881e14f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds4G", "os-flavor-access:is_public": true, "vcpus": 4, "disk": 20}} {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:11:09.001827 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-e677f49a-a94b-41f1-aaac-f6ae7881e14f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.492755 Oct 26 11:11:09.002379 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 8/17] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Oct 26 11:11:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 11:11:09.019357 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-149801d4-12a0-4c80-8232-f72cdc03faa7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:11:09.091708 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-149801d4-12a0-4c80-8232-f72cdc03faa7 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077392 Oct 26 11:11:09.092223 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 10/18] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Oct 26 11:11:09 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:11:11.656116 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-e677f49a-a94b-41f1-aaac-f6ae7881e14f admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:11:11.657148 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-e677f49a-a94b-41f1-aaac-f6ae7881e14f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 26 11:11:11.657558 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 9/19] 10.222.0.42 () {54 vars in 931 bytes} [Wed Oct 26 11:11:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:11:12.123501 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-1f278878-2adc-4445-8a95-a1f58f9c84d2 admin admin] Calling method '>' {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:11:12.148092 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-1f278878-2adc-4445-8a95-a1f58f9c84d2 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.484356 Oct 26 11:11:12.179965 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1292 bytes} [Wed Oct 26 11:11:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 11:11:14.742301 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-e677f49a-a94b-41f1-aaac-f6ae7881e14f admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:11:14.743409 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-e677f49a-a94b-41f1-aaac-f6ae7881e14f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Oct 26 11:11:14.744107 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 10/21] 10.222.0.42 () {54 vars in 931 bytes} [Wed Oct 26 11:11:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:11:15.130400 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-11526ff8-18c2-4811-b945-2152578738e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "ram": 512, "id": "1", "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny"}} {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:11:15.206856 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-11526ff8-18c2-4811-b945-2152578738e1 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.456398 Oct 26 11:11:15.207413 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 12/22] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Oct 26 11:11:14 2022] POST /compute/v2.1/flavors => generated 402 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 11:11:15.219681 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-e665d6ca-d57e-416b-87d5-1025c2e88b9e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:11:15.313519 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-e665d6ca-d57e-416b-87d5-1025c2e88b9e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097432 Oct 26 11:11:15.314069 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 11/23] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Oct 26 11:11:15 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:11:17.909611 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-11526ff8-18c2-4811-b945-2152578738e1 admin admin] Calling method '>' {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:11:17.910609 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-11526ff8-18c2-4811-b945-2152578738e1 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Oct 26 11:11:17.911041 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 931 bytes} [Wed Oct 26 11:11:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:11:18.310175 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-fda24912-bd4d-4308-a668-7876b1140a15 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "2", "rxtx_factor": 1.0, "name": "m1.small", "vcpus": 1, "swap": 0}} {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:11:18.394854 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-fda24912-bd4d-4308-a668-7876b1140a15 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.477617 Oct 26 11:11:18.395407 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 12/25] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Oct 26 11:11:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 11:11:18.407668 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-497779f3-759e-4705-9516-b10b45a9437a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:11:18.478834 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-497779f3-759e-4705-9516-b10b45a9437a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074876 Oct 26 11:11:18.479426 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 14/26] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Oct 26 11:11:18 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:11:21.102516 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-fda24912-bd4d-4308-a668-7876b1140a15 admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:11:21.104352 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-fda24912-bd4d-4308-a668-7876b1140a15 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002272 Oct 26 11:11:21.104758 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 931 bytes} [Wed Oct 26 11:11:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:11:21.552786 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-a8e08812-33fe-4d06-9b0f-192912586cbc admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "id": "3", "os-flavor-access:is_public": true, "name": "m1.medium", "disk": 40, "rxtx_factor": 1.0}} {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:11:21.630318 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-a8e08812-33fe-4d06-9b0f-192912586cbc admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.519675 Oct 26 11:11:21.631265 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Oct 26 11:11:21 2022] POST /compute/v2.1/flavors => generated 406 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 11:11:21.643542 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-cdb12179-1430-4c20-a1e3-8225ad57df5c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:11:21.648686 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG dbcounter [-] [104255] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:21.739719 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-cdb12179-1430-4c20-a1e3-8225ad57df5c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097414 Oct 26 11:11:21.747982 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 14/29] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Oct 26 11:11:21 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:11:24.419532 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-a8e08812-33fe-4d06-9b0f-192912586cbc admin admin] Calling method '>' {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:11:24.420797 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-a8e08812-33fe-4d06-9b0f-192912586cbc admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Oct 26 11:11:24.421537 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 931 bytes} [Wed Oct 26 11:11:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:11:24.876229 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-d74d9f88-4f94-4c3b-84f6-1ed46068d0a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "vcpus": 4, "swap": 0, "name": "m1.large", "id": "4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "os-flavor-access:is_public": true}} {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:11:24.971159 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-d74d9f88-4f94-4c3b-84f6-1ed46068d0a0 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.543144 Oct 26 11:11:24.971638 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 15/31] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Oct 26 11:11:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 11:11:24.984357 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-229e7213-4e8b-4cb8-bd8c-3f92b9a8c65f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:11:25.062360 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-229e7213-4e8b-4cb8-bd8c-3f92b9a8c65f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081313 Oct 26 11:11:25.062985 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 17/32] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Oct 26 11:11:24 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:11:27.679128 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-d74d9f88-4f94-4c3b-84f6-1ed46068d0a0 admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:11:27.680612 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-d74d9f88-4f94-4c3b-84f6-1ed46068d0a0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Oct 26 11:11:27.681018 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 16/33] 10.222.0.42 () {54 vars in 931 bytes} [Wed Oct 26 11:11:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:11:28.117070 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-8477db34-db64-4c55-ba25-0049393272b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 160, "ram": 16384, "swap": 0, "name": "m1.xlarge", "id": "5"}} {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:11:28.244099 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-8477db34-db64-4c55-ba25-0049393272b5 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.556822 Oct 26 11:11:28.244604 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 18/34] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Oct 26 11:11:27 2022] POST /compute/v2.1/flavors => generated 408 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 11:11:28.256506 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-4d758364-7cab-4b50-a723-b6612d2ef119 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:11:28.335601 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-4d758364-7cab-4b50-a723-b6612d2ef119 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082711 Oct 26 11:11:28.336879 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 17/35] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Oct 26 11:11:28 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:11:45.291695 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-8477db34-db64-4c55-ba25-0049393272b5 admin admin] Calling method '>' {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:11:45.292638 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-8477db34-db64-4c55-ba25-0049393272b5 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Oct 26 11:11:45.293038 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 931 bytes} [Wed Oct 26 11:11:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:11:45.303382 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG dbcounter [-] [104255] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:45.678003 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-12d53d36-cf04-4a85-9134-3ec3deec6537 admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:11:45.696952 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-12d53d36-cf04-4a85-9134-3ec3deec6537 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.398038 Oct 26 11:11:45.697492 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1292 bytes} [Wed Oct 26 11:11:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:11:46.987551 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-8477db34-db64-4c55-ba25-0049393272b5 admin admin] Calling method '>' {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:11:46.988568 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-8477db34-db64-4c55-ba25-0049393272b5 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Oct 26 11:11:46.988965 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Oct 26 11:11:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:11:47.517583 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-b5446eaf-03aa-42d7-9645-7a5f935899c7 admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:11:47.523453 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.wsgi [None req-b5446eaf-03aa-42d7-9645-7a5f935899c7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 26 11:11:47.526631 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-b5446eaf-03aa-42d7-9645-7a5f935899c7 admin admin] Request method failure captured: Oct 26 11:11:47.526631 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 26 11:11:47.526631 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: Accept: application/json Oct 26 11:11:47.526631 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: Accept-Encoding: gzip, deflate Oct 26 11:11:47.526631 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: Connection: keep-alive Oct 26 11:11:47.526631 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: Content-Length: 0 Oct 26 11:11:47.526631 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: Host: 10.222.0.42 Oct 26 11:11:47.526631 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: Openstack-Api-Version: compute 2.92 Oct 26 11:11:47.526631 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: Openstack-System-Scope: None Oct 26 11:11:47.526631 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: User-Agent: python-novaclient Oct 26 11:11:47.526631 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Auth-Token: gAAAAABjWRXyIbStRL__kjqUymmEXv1REI1SYcbL3G9wbXYMcvZGgkwZRFCaMWCdaz7FiTzNdtUxG-epeVLzucXtD3qcZ6gLzFHD8ZcoNd0WZRFF_SvF4Gv8TjaB-siuYXL5cW3cshVTio1C1i9SEp8QAlwV5eVh5_OOGj4CPhkJFy0VPthd_fw Oct 26 11:11:47.526631 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Domain-Id: None Oct 26 11:11:47.526631 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Domain-Name: None Oct 26 11:11:47.526631 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Identity-Status: Confirmed Oct 26 11:11:47.526631 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Is-Admin-Project: True Oct 26 11:11:47.526631 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Openstack-Nova-Api-Version: 2.92 Oct 26 11:11:47.526631 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Project-Domain-Id: default Oct 26 11:11:47.526631 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Project-Domain-Name: Default Oct 26 11:11:47.526631 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Project-Id: 6d130249a55c4bbea044091c5d05b944 Oct 26 11:11:47.526631 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Project-Name: admin Oct 26 11:11:47.526631 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Role: member,admin,reader Oct 26 11:11:47.526631 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Roles: member,admin,reader Oct 26 11:11:47.528342 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6d130249a55c4bbea044091c5d05b944", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6d130249a55c4bbea044091c5d05b944"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6d130249a55c4bbea044091c5d05b944"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6d130249a55c4bbea044091c5d05b944"}]}] Oct 26 11:11:47.528342 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Tenant: admin Oct 26 11:11:47.528342 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Tenant-Id: 6d130249a55c4bbea044091c5d05b944 Oct 26 11:11:47.528342 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Tenant-Name: admin Oct 26 11:11:47.528342 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-User: admin Oct 26 11:11:47.528342 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-User-Domain-Id: default Oct 26 11:11:47.528342 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-User-Domain-Name: Default Oct 26 11:11:47.528342 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-User-Id: e3c50bbb7acb4f91ac247acc31363261 Oct 26 11:11:47.528342 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-User-Name: admin Oct 26 11:11:47.528342 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: method: > Oct 26 11:11:47.528342 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: exception: Flavor 42 could not be found. Oct 26 11:11:47.528342 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: action_args: {'id': '42'} Oct 26 11:11:47.528342 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:11:47.528342 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:11:47.529406 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 26 11:11:47.529406 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 26 11:11:47.529406 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 26 11:11:47.529406 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 26 11:11:47.529406 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 11:11:47.529406 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 11:11:47.529406 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 26 11:11:47.529406 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 26 11:11:47.529406 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 26 11:11:47.529406 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:11:47.529406 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 26 11:11:47.529406 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 26 11:11:47.529406 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 26 11:11:47.529406 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Oct 26 11:11:47.529406 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:11:47.529406 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Oct 26 11:11:47.529406 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:11:47.529406 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:11:47.529406 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:11:47.530914 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:11:47.530914 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:11:47.530914 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:11:47.530914 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:11:47.530914 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 26 11:11:47.530914 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:11:47.530914 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 26 11:11:47.530914 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Oct 26 11:11:47.530914 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:11:47.530914 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Oct 26 11:11:47.530914 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:11:47.530914 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:11:47.530914 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:11:47.530914 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:11:47.530914 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:11:47.530914 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 26 11:11:47.530914 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Oct 26 11:11:47.530914 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-b5446eaf-03aa-42d7-9645-7a5f935899c7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:11:47.532476 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-b5446eaf-03aa-42d7-9645-7a5f935899c7 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.392845 Oct 26 11:11:47.532476 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Oct 26 11:11:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:47.537748 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-fea34f55-4b16-4ddf-8383-416f4914b48f admin admin] Calling method '>' {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:11:47.541916 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG dbcounter [-] [104256] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=104256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:11:47.560320 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-fea34f55-4b16-4ddf-8383-416f4914b48f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026165 Oct 26 11:11:47.560844 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Oct 26 11:11:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:11:47.571804 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-a17eaf92-4dfd-46d0-9aed-7edf3f13d9e1 admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:11:47.593675 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-a17eaf92-4dfd-46d0-9aed-7edf3f13d9e1 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026794 Oct 26 11:11:47.594219 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Oct 26 11:11:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:11:47.603240 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-6d663f7b-0224-452e-bcf5-56978f0eba11 admin admin] Calling method '>' {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:11:47.608891 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.wsgi [None req-6d663f7b-0224-452e-bcf5-56978f0eba11 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 26 11:11:47.612398 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-6d663f7b-0224-452e-bcf5-56978f0eba11 admin admin] Request method failure captured: Oct 26 11:11:47.612398 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 26 11:11:47.612398 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: Accept: application/json Oct 26 11:11:47.612398 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: Accept-Encoding: gzip, deflate Oct 26 11:11:47.612398 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: Connection: keep-alive Oct 26 11:11:47.612398 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: Content-Length: 0 Oct 26 11:11:47.612398 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: Host: 10.222.0.42 Oct 26 11:11:47.612398 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: Openstack-Api-Version: compute 2.92 Oct 26 11:11:47.612398 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: Openstack-System-Scope: None Oct 26 11:11:47.612398 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: User-Agent: python-novaclient Oct 26 11:11:47.612398 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Auth-Token: gAAAAABjWRXyIbStRL__kjqUymmEXv1REI1SYcbL3G9wbXYMcvZGgkwZRFCaMWCdaz7FiTzNdtUxG-epeVLzucXtD3qcZ6gLzFHD8ZcoNd0WZRFF_SvF4Gv8TjaB-siuYXL5cW3cshVTio1C1i9SEp8QAlwV5eVh5_OOGj4CPhkJFy0VPthd_fw Oct 26 11:11:47.612398 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Domain-Id: None Oct 26 11:11:47.612398 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Domain-Name: None Oct 26 11:11:47.612398 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Identity-Status: Confirmed Oct 26 11:11:47.612398 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Is-Admin-Project: True Oct 26 11:11:47.612398 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Openstack-Nova-Api-Version: 2.92 Oct 26 11:11:47.612398 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Project-Domain-Id: default Oct 26 11:11:47.612398 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Project-Domain-Name: Default Oct 26 11:11:47.612398 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Project-Id: 6d130249a55c4bbea044091c5d05b944 Oct 26 11:11:47.612398 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Project-Name: admin Oct 26 11:11:47.612398 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Role: member,admin,reader Oct 26 11:11:47.612398 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Roles: member,admin,reader Oct 26 11:11:47.620406 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6d130249a55c4bbea044091c5d05b944", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6d130249a55c4bbea044091c5d05b944"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6d130249a55c4bbea044091c5d05b944"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6d130249a55c4bbea044091c5d05b944"}]}] Oct 26 11:11:47.620406 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Tenant: admin Oct 26 11:11:47.620406 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Tenant-Id: 6d130249a55c4bbea044091c5d05b944 Oct 26 11:11:47.620406 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Tenant-Name: admin Oct 26 11:11:47.620406 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-User: admin Oct 26 11:11:47.620406 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-User-Domain-Id: default Oct 26 11:11:47.620406 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-User-Domain-Name: Default Oct 26 11:11:47.620406 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-User-Id: e3c50bbb7acb4f91ac247acc31363261 Oct 26 11:11:47.620406 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-User-Name: admin Oct 26 11:11:47.620406 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: method: > Oct 26 11:11:47.620406 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: exception: Flavor 42 could not be found. Oct 26 11:11:47.620406 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: action_args: {'id': '42'} Oct 26 11:11:47.620406 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:11:47.620406 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:11:47.621372 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 26 11:11:47.621372 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 26 11:11:47.621372 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 26 11:11:47.621372 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 26 11:11:47.621372 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 11:11:47.621372 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 11:11:47.621372 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 26 11:11:47.621372 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 26 11:11:47.621372 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 26 11:11:47.621372 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:11:47.621372 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 26 11:11:47.621372 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 26 11:11:47.621372 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 26 11:11:47.621372 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi Oct 26 11:11:47.621372 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:11:47.621372 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi Oct 26 11:11:47.621372 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:11:47.621372 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:11:47.621372 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:11:47.622525 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:11:47.622525 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:11:47.622525 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:11:47.622525 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:11:47.622525 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 26 11:11:47.622525 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:11:47.622525 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 26 11:11:47.622525 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi Oct 26 11:11:47.622525 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:11:47.622525 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi Oct 26 11:11:47.622525 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:11:47.622525 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:11:47.622525 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:11:47.622525 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:11:47.622525 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:11:47.622525 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 26 11:11:47.622525 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi Oct 26 11:11:47.622525 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-6d663f7b-0224-452e-bcf5-56978f0eba11 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:11:47.623570 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-6d663f7b-0224-452e-bcf5-56978f0eba11 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014003 Oct 26 11:11:47.623570 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Oct 26 11:11:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:48.802710 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-a17eaf92-4dfd-46d0-9aed-7edf3f13d9e1 admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:11:48.803743 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-a17eaf92-4dfd-46d0-9aed-7edf3f13d9e1 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 26 11:11:48.804143 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Oct 26 11:11:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:11:49.320195 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-c57616c1-657a-4fa3-a735-d0d9c379305e admin admin] Calling method '>' {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:11:49.325225 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.wsgi [None req-c57616c1-657a-4fa3-a735-d0d9c379305e admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 26 11:11:49.326733 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-c57616c1-657a-4fa3-a735-d0d9c379305e admin admin] Request method failure captured: Oct 26 11:11:49.326733 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 26 11:11:49.326733 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: Accept: application/json Oct 26 11:11:49.326733 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: Accept-Encoding: gzip, deflate Oct 26 11:11:49.326733 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: Connection: keep-alive Oct 26 11:11:49.326733 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: Content-Length: 0 Oct 26 11:11:49.326733 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: Host: 10.222.0.42 Oct 26 11:11:49.326733 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: Openstack-Api-Version: compute 2.92 Oct 26 11:11:49.326733 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: Openstack-System-Scope: None Oct 26 11:11:49.326733 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: User-Agent: python-novaclient Oct 26 11:11:49.326733 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Auth-Token: gAAAAABjWRX08B6XCSDsb3lcYDJW2fSf1OOIr1OOcHJhf17MmAYFtr39YIpFztwhVszf-1TiSbojt_NaoGMmAHvZAqUx31RPEfeRupMVo1-q5JiPeUvvyLgo9H_hObUNWyg4UUxaPPV-dS4d_oGVbYwLAhsEcd_l5ejEHxMyhcT7DHNZxmPKO2M Oct 26 11:11:49.326733 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Domain-Id: None Oct 26 11:11:49.326733 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Domain-Name: None Oct 26 11:11:49.326733 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Identity-Status: Confirmed Oct 26 11:11:49.326733 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Is-Admin-Project: True Oct 26 11:11:49.326733 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Openstack-Nova-Api-Version: 2.92 Oct 26 11:11:49.326733 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Project-Domain-Id: default Oct 26 11:11:49.326733 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Project-Domain-Name: Default Oct 26 11:11:49.326733 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Project-Id: 6d130249a55c4bbea044091c5d05b944 Oct 26 11:11:49.326733 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Project-Name: admin Oct 26 11:11:49.326733 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Role: member,admin,reader Oct 26 11:11:49.326733 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Roles: member,admin,reader Oct 26 11:11:49.328448 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6d130249a55c4bbea044091c5d05b944", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6d130249a55c4bbea044091c5d05b944"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6d130249a55c4bbea044091c5d05b944"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6d130249a55c4bbea044091c5d05b944"}]}] Oct 26 11:11:49.328448 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Tenant: admin Oct 26 11:11:49.328448 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Tenant-Id: 6d130249a55c4bbea044091c5d05b944 Oct 26 11:11:49.328448 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Tenant-Name: admin Oct 26 11:11:49.328448 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-User: admin Oct 26 11:11:49.328448 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-User-Domain-Id: default Oct 26 11:11:49.328448 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-User-Domain-Name: Default Oct 26 11:11:49.328448 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-User-Id: e3c50bbb7acb4f91ac247acc31363261 Oct 26 11:11:49.328448 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-User-Name: admin Oct 26 11:11:49.328448 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: method: > Oct 26 11:11:49.328448 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: exception: Flavor 84 could not be found. Oct 26 11:11:49.328448 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: action_args: {'id': '84'} Oct 26 11:11:49.328448 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:11:49.328448 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:11:49.330431 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 26 11:11:49.330431 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 26 11:11:49.330431 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 26 11:11:49.330431 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 26 11:11:49.330431 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 11:11:49.330431 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 11:11:49.330431 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 26 11:11:49.330431 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 26 11:11:49.330431 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 26 11:11:49.330431 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:11:49.330431 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 26 11:11:49.330431 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 26 11:11:49.330431 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 26 11:11:49.330431 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi Oct 26 11:11:49.330431 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:11:49.330431 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi Oct 26 11:11:49.330431 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:11:49.330431 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:11:49.330431 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:11:49.331821 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:11:49.331821 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:11:49.331821 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:11:49.331821 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:11:49.331821 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 26 11:11:49.331821 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:11:49.331821 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 26 11:11:49.331821 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi Oct 26 11:11:49.331821 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:11:49.331821 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi Oct 26 11:11:49.331821 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:11:49.331821 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:11:49.331821 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:11:49.331821 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:11:49.331821 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:11:49.331821 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 26 11:11:49.331821 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi Oct 26 11:11:49.331821 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-c57616c1-657a-4fa3-a735-d0d9c379305e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:11:49.332906 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-c57616c1-657a-4fa3-a735-d0d9c379305e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.386885 Oct 26 11:11:49.332906 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Oct 26 11:11:48 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:49.337772 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-ae671c30-64ed-4955-b798-6b1e3a6b6b82 admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:11:49.352425 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-ae671c30-64ed-4955-b798-6b1e3a6b6b82 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018253 Oct 26 11:11:49.352910 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Oct 26 11:11:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:11:49.362277 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-d6dbfed4-59ec-4288-ae4f-1432b547dc5f admin admin] Calling method '>' {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:11:49.377789 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-d6dbfed4-59ec-4288-ae4f-1432b547dc5f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019246 Oct 26 11:11:49.378311 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Oct 26 11:11:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:11:49.387834 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-cd296d20-054d-43af-91b0-fa2d6d48996f admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:11:49.392629 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.wsgi [None req-cd296d20-054d-43af-91b0-fa2d6d48996f admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 26 11:11:49.394163 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-cd296d20-054d-43af-91b0-fa2d6d48996f admin admin] Request method failure captured: Oct 26 11:11:49.394163 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 26 11:11:49.394163 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: Accept: application/json Oct 26 11:11:49.394163 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: Accept-Encoding: gzip, deflate Oct 26 11:11:49.394163 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: Connection: keep-alive Oct 26 11:11:49.394163 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: Content-Length: 0 Oct 26 11:11:49.394163 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: Host: 10.222.0.42 Oct 26 11:11:49.394163 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: Openstack-Api-Version: compute 2.92 Oct 26 11:11:49.394163 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: Openstack-System-Scope: None Oct 26 11:11:49.394163 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: User-Agent: python-novaclient Oct 26 11:11:49.394163 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Auth-Token: gAAAAABjWRX08B6XCSDsb3lcYDJW2fSf1OOIr1OOcHJhf17MmAYFtr39YIpFztwhVszf-1TiSbojt_NaoGMmAHvZAqUx31RPEfeRupMVo1-q5JiPeUvvyLgo9H_hObUNWyg4UUxaPPV-dS4d_oGVbYwLAhsEcd_l5ejEHxMyhcT7DHNZxmPKO2M Oct 26 11:11:49.394163 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Domain-Id: None Oct 26 11:11:49.394163 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Domain-Name: None Oct 26 11:11:49.394163 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Identity-Status: Confirmed Oct 26 11:11:49.394163 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Is-Admin-Project: True Oct 26 11:11:49.394163 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Openstack-Nova-Api-Version: 2.92 Oct 26 11:11:49.394163 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Project-Domain-Id: default Oct 26 11:11:49.394163 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Project-Domain-Name: Default Oct 26 11:11:49.394163 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Project-Id: 6d130249a55c4bbea044091c5d05b944 Oct 26 11:11:49.394163 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Project-Name: admin Oct 26 11:11:49.394163 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Role: member,admin,reader Oct 26 11:11:49.394163 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Roles: member,admin,reader Oct 26 11:11:49.395720 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6d130249a55c4bbea044091c5d05b944", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6d130249a55c4bbea044091c5d05b944"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6d130249a55c4bbea044091c5d05b944"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6d130249a55c4bbea044091c5d05b944"}]}] Oct 26 11:11:49.395720 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Tenant: admin Oct 26 11:11:49.395720 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Tenant-Id: 6d130249a55c4bbea044091c5d05b944 Oct 26 11:11:49.395720 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Tenant-Name: admin Oct 26 11:11:49.395720 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-User: admin Oct 26 11:11:49.395720 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-User-Domain-Id: default Oct 26 11:11:49.395720 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-User-Domain-Name: Default Oct 26 11:11:49.395720 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-User-Id: e3c50bbb7acb4f91ac247acc31363261 Oct 26 11:11:49.395720 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-User-Name: admin Oct 26 11:11:49.395720 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: method: > Oct 26 11:11:49.395720 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: exception: Flavor 84 could not be found. Oct 26 11:11:49.395720 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: action_args: {'id': '84'} Oct 26 11:11:49.395720 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:11:49.395720 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:11:49.396845 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 26 11:11:49.396845 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 26 11:11:49.396845 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 26 11:11:49.396845 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 26 11:11:49.396845 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 11:11:49.396845 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 11:11:49.396845 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 26 11:11:49.396845 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 26 11:11:49.396845 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 26 11:11:49.396845 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:11:49.396845 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 26 11:11:49.396845 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 26 11:11:49.396845 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 26 11:11:49.396845 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Oct 26 11:11:49.396845 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:11:49.396845 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Oct 26 11:11:49.396845 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:11:49.396845 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:11:49.396845 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:11:49.398120 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:11:49.398120 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:11:49.398120 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:11:49.398120 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:11:49.398120 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 26 11:11:49.398120 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:11:49.398120 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 26 11:11:49.398120 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Oct 26 11:11:49.398120 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:11:49.398120 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Oct 26 11:11:49.398120 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:11:49.398120 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:11:49.398120 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:11:49.398120 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:11:49.398120 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:11:49.398120 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 26 11:11:49.398120 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Oct 26 11:11:49.398120 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-cd296d20-054d-43af-91b0-fa2d6d48996f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:11:49.399367 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-cd296d20-054d-43af-91b0-fa2d6d48996f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011155 Oct 26 11:11:49.399367 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 23/47] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Oct 26 11:11:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 26 11:11:50.590272 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-d6dbfed4-59ec-4288-ae4f-1432b547dc5f admin admin] Calling method '>' {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:11:50.591303 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-d6dbfed4-59ec-4288-ae4f-1432b547dc5f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Oct 26 11:11:50.591700 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 25/48] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Oct 26 11:11:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:11:51.106099 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-7f7c5fd8-8583-4f60-be68-842584bb0b18 admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:11:51.112312 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.wsgi [None req-7f7c5fd8-8583-4f60-be68-842584bb0b18 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 26 11:11:51.113865 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-7f7c5fd8-8583-4f60-be68-842584bb0b18 admin admin] Request method failure captured: Oct 26 11:11:51.113865 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 26 11:11:51.113865 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: Accept: application/json Oct 26 11:11:51.113865 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: Accept-Encoding: gzip, deflate Oct 26 11:11:51.113865 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: Connection: keep-alive Oct 26 11:11:51.113865 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: Content-Length: 0 Oct 26 11:11:51.113865 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: Host: 10.222.0.42 Oct 26 11:11:51.113865 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: Openstack-Api-Version: compute 2.92 Oct 26 11:11:51.113865 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: Openstack-System-Scope: None Oct 26 11:11:51.113865 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: User-Agent: python-novaclient Oct 26 11:11:51.113865 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Auth-Token: gAAAAABjWRX2xhTNPSl3O9foKu8UeNqglbjUKlCwRFqUZgA9KVY4Rb-538T8bvhE_hS2QQi6SCKYiv0-iM9OLyz7jzjEqZ1mD9mDwhz4uoTTISeDlaWHV0EyUOFBgogXdi5lDExK0uXVyW-el5gP9hIvQDpBOU2HuqcaQAQbWuBzSkClblLLiaY Oct 26 11:11:51.113865 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Domain-Id: None Oct 26 11:11:51.113865 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Domain-Name: None Oct 26 11:11:51.113865 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Identity-Status: Confirmed Oct 26 11:11:51.113865 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Is-Admin-Project: True Oct 26 11:11:51.113865 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Openstack-Nova-Api-Version: 2.92 Oct 26 11:11:51.113865 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Project-Domain-Id: default Oct 26 11:11:51.113865 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Project-Domain-Name: Default Oct 26 11:11:51.113865 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Project-Id: 6d130249a55c4bbea044091c5d05b944 Oct 26 11:11:51.113865 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Project-Name: admin Oct 26 11:11:51.113865 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Role: member,admin,reader Oct 26 11:11:51.113865 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Roles: member,admin,reader Oct 26 11:11:51.115467 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6d130249a55c4bbea044091c5d05b944", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6d130249a55c4bbea044091c5d05b944"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6d130249a55c4bbea044091c5d05b944"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6d130249a55c4bbea044091c5d05b944"}]}] Oct 26 11:11:51.115467 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Tenant: admin Oct 26 11:11:51.115467 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Tenant-Id: 6d130249a55c4bbea044091c5d05b944 Oct 26 11:11:51.115467 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-Tenant-Name: admin Oct 26 11:11:51.115467 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-User: admin Oct 26 11:11:51.115467 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-User-Domain-Id: default Oct 26 11:11:51.115467 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-User-Domain-Name: Default Oct 26 11:11:51.115467 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-User-Id: e3c50bbb7acb4f91ac247acc31363261 Oct 26 11:11:51.115467 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: X-User-Name: admin Oct 26 11:11:51.115467 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: method: > Oct 26 11:11:51.115467 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: exception: Flavor 451 could not be found. Oct 26 11:11:51.115467 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: action_args: {'id': '451'} Oct 26 11:11:51.115467 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:11:51.115467 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:11:51.116412 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 26 11:11:51.116412 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 26 11:11:51.116412 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 26 11:11:51.116412 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 26 11:11:51.116412 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 11:11:51.116412 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 11:11:51.116412 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 26 11:11:51.116412 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 26 11:11:51.116412 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 26 11:11:51.116412 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:11:51.116412 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 26 11:11:51.116412 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 26 11:11:51.116412 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 26 11:11:51.116412 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Oct 26 11:11:51.116412 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:11:51.116412 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Oct 26 11:11:51.116412 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:11:51.116412 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:11:51.116412 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:11:51.117800 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:11:51.117800 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:11:51.117800 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:11:51.117800 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:11:51.117800 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 26 11:11:51.117800 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:11:51.117800 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 26 11:11:51.117800 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Oct 26 11:11:51.117800 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:11:51.117800 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Oct 26 11:11:51.117800 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:11:51.117800 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:11:51.117800 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:11:51.117800 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:11:51.117800 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:11:51.117800 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 26 11:11:51.117800 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: ERROR nova.api.openstack.wsgi Oct 26 11:11:51.117800 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-7f7c5fd8-8583-4f60-be68-842584bb0b18 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:11:51.119037 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-7f7c5fd8-8583-4f60-be68-842584bb0b18 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.388131 Oct 26 11:11:51.119037 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Oct 26 11:11:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:51.124885 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-bba2e255-6897-4283-932b-0c3c78f6a76b admin admin] Calling method '>' {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:11:51.139925 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-bba2e255-6897-4283-932b-0c3c78f6a76b admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018627 Oct 26 11:11:51.141253 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Oct 26 11:11:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:11:51.150233 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-96cb2602-d5db-49c4-98db-8f32e789302b admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:11:51.165071 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-96cb2602-d5db-49c4-98db-8f32e789302b admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018879 Oct 26 11:11:51.167303 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 25/51] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Oct 26 11:11:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:11:51.175308 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-4b624c71-2f1d-42dd-b136-6eeccb9dab51 admin admin] Calling method '>' {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:11:51.180331 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.wsgi [None req-4b624c71-2f1d-42dd-b136-6eeccb9dab51 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 26 11:11:51.181860 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-4b624c71-2f1d-42dd-b136-6eeccb9dab51 admin admin] Request method failure captured: Oct 26 11:11:51.181860 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 26 11:11:51.181860 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: Accept: application/json Oct 26 11:11:51.181860 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: Accept-Encoding: gzip, deflate Oct 26 11:11:51.181860 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: Connection: keep-alive Oct 26 11:11:51.181860 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: Content-Length: 0 Oct 26 11:11:51.181860 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: Host: 10.222.0.42 Oct 26 11:11:51.181860 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: Openstack-Api-Version: compute 2.92 Oct 26 11:11:51.181860 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: Openstack-System-Scope: None Oct 26 11:11:51.181860 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: User-Agent: python-novaclient Oct 26 11:11:51.181860 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Auth-Token: gAAAAABjWRX2xhTNPSl3O9foKu8UeNqglbjUKlCwRFqUZgA9KVY4Rb-538T8bvhE_hS2QQi6SCKYiv0-iM9OLyz7jzjEqZ1mD9mDwhz4uoTTISeDlaWHV0EyUOFBgogXdi5lDExK0uXVyW-el5gP9hIvQDpBOU2HuqcaQAQbWuBzSkClblLLiaY Oct 26 11:11:51.181860 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Domain-Id: None Oct 26 11:11:51.181860 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Domain-Name: None Oct 26 11:11:51.181860 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Identity-Status: Confirmed Oct 26 11:11:51.181860 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Is-Admin-Project: True Oct 26 11:11:51.181860 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Openstack-Nova-Api-Version: 2.92 Oct 26 11:11:51.181860 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Project-Domain-Id: default Oct 26 11:11:51.181860 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Project-Domain-Name: Default Oct 26 11:11:51.181860 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Project-Id: 6d130249a55c4bbea044091c5d05b944 Oct 26 11:11:51.181860 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Project-Name: admin Oct 26 11:11:51.181860 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Role: member,admin,reader Oct 26 11:11:51.181860 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Roles: member,admin,reader Oct 26 11:11:51.183388 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6d130249a55c4bbea044091c5d05b944", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6d130249a55c4bbea044091c5d05b944"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6d130249a55c4bbea044091c5d05b944"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6d130249a55c4bbea044091c5d05b944"}]}] Oct 26 11:11:51.183388 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Tenant: admin Oct 26 11:11:51.183388 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Tenant-Id: 6d130249a55c4bbea044091c5d05b944 Oct 26 11:11:51.183388 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-Tenant-Name: admin Oct 26 11:11:51.183388 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-User: admin Oct 26 11:11:51.183388 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-User-Domain-Id: default Oct 26 11:11:51.183388 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-User-Domain-Name: Default Oct 26 11:11:51.183388 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-User-Id: e3c50bbb7acb4f91ac247acc31363261 Oct 26 11:11:51.183388 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: X-User-Name: admin Oct 26 11:11:51.183388 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: method: > Oct 26 11:11:51.183388 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: exception: Flavor 451 could not be found. Oct 26 11:11:51.183388 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: action_args: {'id': '451'} Oct 26 11:11:51.183388 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:11:51.183388 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:11:51.184300 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 26 11:11:51.184300 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 26 11:11:51.184300 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 26 11:11:51.184300 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 26 11:11:51.184300 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 11:11:51.184300 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 11:11:51.184300 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 26 11:11:51.184300 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 26 11:11:51.184300 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 26 11:11:51.184300 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:11:51.184300 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 26 11:11:51.184300 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 26 11:11:51.184300 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 26 11:11:51.184300 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi Oct 26 11:11:51.184300 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:11:51.184300 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi Oct 26 11:11:51.184300 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:11:51.184300 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:11:51.184300 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:11:51.185369 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:11:51.185369 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:11:51.185369 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:11:51.185369 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:11:51.185369 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 26 11:11:51.185369 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:11:51.185369 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 26 11:11:51.185369 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi Oct 26 11:11:51.185369 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:11:51.185369 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi Oct 26 11:11:51.185369 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:11:51.185369 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:11:51.185369 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:11:51.185369 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:11:51.185369 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:11:51.185369 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 26 11:11:51.185369 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: ERROR nova.api.openstack.wsgi Oct 26 11:11:51.185369 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-4b624c71-2f1d-42dd-b136-6eeccb9dab51 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:11:51.186354 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-4b624c71-2f1d-42dd-b136-6eeccb9dab51 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011374 Oct 26 11:11:51.186354 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Oct 26 11:11:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 26 11:11:52.372185 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-96cb2602-d5db-49c4-98db-8f32e789302b admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:11:52.373204 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-96cb2602-d5db-49c4-98db-8f32e789302b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Oct 26 11:11:52.373604 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Oct 26 11:11:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:11:52.901833 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-bb5fa7db-ddf9-4136-98ed-43107925bc99 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:11:52.981679 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-bb5fa7db-ddf9-4136-98ed-43107925bc99 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.468475 Oct 26 11:11:52.982233 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 28/54] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Oct 26 11:11:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 11:11:54.188851 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-96cb2602-d5db-49c4-98db-8f32e789302b admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:11:54.189888 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-96cb2602-d5db-49c4-98db-8f32e789302b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 26 11:11:54.193467 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Oct 26 11:11:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:11:54.709606 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-3cb3b98c-e5d7-4c8e-b4ed-41f4b3570b21 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:11:54.821747 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-3cb3b98c-e5d7-4c8e-b4ed-41f4b3570b21 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.492825 Oct 26 11:11:54.822307 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 29/56] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Oct 26 11:11:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 11:11:56.010957 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-96cb2602-d5db-49c4-98db-8f32e789302b admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:11:56.011971 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-96cb2602-d5db-49c4-98db-8f32e789302b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 26 11:11:56.012368 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Oct 26 11:11:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:11:56.522434 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-6409f476-bcc7-4e77-83d1-9b1d6bbb1007 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:11:56.596676 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-6409f476-bcc7-4e77-83d1-9b1d6bbb1007 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.449157 Oct 26 11:11:56.597156 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 30/58] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Oct 26 11:11:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 11:11:57.798550 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-96cb2602-d5db-49c4-98db-8f32e789302b admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:11:57.799577 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-96cb2602-d5db-49c4-98db-8f32e789302b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Oct 26 11:11:57.799971 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 29/59] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Oct 26 11:11:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:11:58.314315 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-410dd74c-511c-4e42-badc-e1622efd96f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:11:58.397871 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-410dd74c-511c-4e42-badc-e1622efd96f9 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.460330 Oct 26 11:11:58.398411 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 31/60] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Oct 26 11:11:57 2022] POST /compute/v2.1/flavors => generated 409 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 11:11:59.591772 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-96cb2602-d5db-49c4-98db-8f32e789302b admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:11:59.592780 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-96cb2602-d5db-49c4-98db-8f32e789302b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Oct 26 11:11:59.593184 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 30/61] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Oct 26 11:11:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:12:00.108205 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-88c8c80b-9d64-48b9-8911-91b87ec407a3 admin admin] Calling method '>' {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:12:00.128576 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-88c8c80b-9d64-48b9-8911-91b87ec407a3 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.398744 Oct 26 11:12:00.129106 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 32/62] 10.222.0.42 () {60 vars in 1202 bytes} [Wed Oct 26 11:11:59 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:12:56.282548 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-96cb2602-d5db-49c4-98db-8f32e789302b admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:12:56.284013 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-96cb2602-d5db-49c4-98db-8f32e789302b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002103 Oct 26 11:12:56.284441 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 31/63] 10.222.0.42 () {54 vars in 931 bytes} [Wed Oct 26 11:12:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:12:56.295035 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG dbcounter [-] [104256] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=104256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:56.666117 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-611db6dc-9419-49ed-a6f6-ef9a04ed47b8 admin admin] Calling method '>' {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:12:56.685965 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-611db6dc-9419-49ed-a6f6-ef9a04ed47b8 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.395473 Oct 26 11:12:56.686497 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1292 bytes} [Wed Oct 26 11:12:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:12:56.708876 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG dbcounter [-] [104255] Writing DB stats nova_api:SELECT=14 {{(pid=104255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:12:56.712616 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-bcaec28e-f0a7-4150-b58a-81eb35d2f6c2 admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:12:56.719884 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-bcaec28e-f0a7-4150-b58a-81eb35d2f6c2 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012453 Oct 26 11:12:56.720400 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1283 bytes} [Wed Oct 26 11:12:56 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:12:56.732547 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-08197426-dba4-4a21-87ab-234729047acb admin admin] Calling method '>' {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:12:56.740676 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-08197426-dba4-4a21-87ab-234729047acb admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011807 Oct 26 11:12:56.743443 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 34/66] 10.222.0.42 () {60 vars in 1286 bytes} [Wed Oct 26 11:12:56 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:12:56.753846 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-9cb2c542-b4fa-49fa-b153-3cc2f0ad0e6d admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:12:56.761796 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-9cb2c542-b4fa-49fa-b153-3cc2f0ad0e6d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012499 Oct 26 11:12:56.762354 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1286 bytes} [Wed Oct 26 11:12:56 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:12:56.773699 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-c95a890a-e22d-4a69-8bf9-05d0dbe6fc5c admin admin] Calling method '>' {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:12:56.780840 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-c95a890a-e22d-4a69-8bf9-05d0dbe6fc5c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010701 Oct 26 11:12:56.781374 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 35/68] 10.222.0.42 () {60 vars in 1283 bytes} [Wed Oct 26 11:12:56 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:16:02.009206 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-9cb2c542-b4fa-49fa-b153-3cc2f0ad0e6d admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:16:02.011964 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-9cb2c542-b4fa-49fa-b153-3cc2f0ad0e6d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Oct 26 11:16:02.011964 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 34/69] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Oct 26 11:16:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:16:02.151762 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG dbcounter [-] [104256] Writing DB stats nova_api:SELECT=6 {{(pid=104256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:02.308827 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-22715f81-55dd-497e-a3d0-8c161242caf8 admin admin] Calling method '>' {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:16:02.313595 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_concurrency.lockutils [None req-22715f81-55dd-497e-a3d0-8c161242caf8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:16:02.314064 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_concurrency.lockutils [None req-22715f81-55dd-497e-a3d0-8c161242caf8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:16:02.314485 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_concurrency.lockutils [None req-22715f81-55dd-497e-a3d0-8c161242caf8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:16:02.315839 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_concurrency.lockutils [None req-22715f81-55dd-497e-a3d0-8c161242caf8 admin admin] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:16:02.316284 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_concurrency.lockutils [None req-22715f81-55dd-497e-a3d0-8c161242caf8 admin admin] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:16:02.316694 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_concurrency.lockutils [None req-22715f81-55dd-497e-a3d0-8c161242caf8 admin admin] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:16:02.347550 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-22715f81-55dd-497e-a3d0-8c161242caf8 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.197000 Oct 26 11:16:02.348096 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 36/70] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Oct 26 11:16:02 2022] GET /compute/v2.1/os-services => generated 794 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 11:16:03.410509 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-9cb2c542-b4fa-49fa-b153-3cc2f0ad0e6d admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:16:03.411565 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-9cb2c542-b4fa-49fa-b153-3cc2f0ad0e6d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Oct 26 11:16:03.411963 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Oct 26 11:16:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:16:03.602838 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-5dc454ea-94c8-45ac-8e8f-a173502b1382 admin admin] Calling method '>' {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:16:03.606514 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_concurrency.lockutils [None req-5dc454ea-94c8-45ac-8e8f-a173502b1382 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:16:03.607026 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_concurrency.lockutils [None req-5dc454ea-94c8-45ac-8e8f-a173502b1382 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:16:03.607455 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_concurrency.lockutils [None req-5dc454ea-94c8-45ac-8e8f-a173502b1382 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:16:03.608167 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_concurrency.lockutils [None req-5dc454ea-94c8-45ac-8e8f-a173502b1382 admin admin] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:16:03.608615 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_concurrency.lockutils [None req-5dc454ea-94c8-45ac-8e8f-a173502b1382 admin admin] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:16:03.609038 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_concurrency.lockutils [None req-5dc454ea-94c8-45ac-8e8f-a173502b1382 admin admin] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:16:03.628034 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-5dc454ea-94c8-45ac-8e8f-a173502b1382 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.077747 Oct 26 11:16:03.628517 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 37/72] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Oct 26 11:16:03 2022] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 11:16:15.102535 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-9cb2c542-b4fa-49fa-b153-3cc2f0ad0e6d admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:16:15.103576 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-9cb2c542-b4fa-49fa-b153-3cc2f0ad0e6d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 26 11:16:15.103970 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Oct 26 11:16:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:16:15.245812 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG dbcounter [-] [104256] Writing DB stats nova_cell0:SELECT=4 {{(pid=104256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:15.246564 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG dbcounter [-] [104256] Writing DB stats nova_cell1:SELECT=4 {{(pid=104256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:15.247191 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG dbcounter [-] [104256] Writing DB stats nova_api:SELECT=8 {{(pid=104256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:16:15.294965 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-b6466c05-4fb4-4160-a277-de4c449c17c7 admin admin] Calling method '>' {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:16:15.298295 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_concurrency.lockutils [None req-b6466c05-4fb4-4160-a277-de4c449c17c7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:16:15.298786 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_concurrency.lockutils [None req-b6466c05-4fb4-4160-a277-de4c449c17c7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:16:15.303505 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_concurrency.lockutils [None req-b6466c05-4fb4-4160-a277-de4c449c17c7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:16:15.303505 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_concurrency.lockutils [None req-b6466c05-4fb4-4160-a277-de4c449c17c7 admin admin] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:16:15.303505 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_concurrency.lockutils [None req-b6466c05-4fb4-4160-a277-de4c449c17c7 admin admin] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:16:15.303505 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_concurrency.lockutils [None req-b6466c05-4fb4-4160-a277-de4c449c17c7 admin admin] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:16:15.326454 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-b6466c05-4fb4-4160-a277-de4c449c17c7 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.085009 Oct 26 11:16:15.326649 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 38/74] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Oct 26 11:16:15 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:16:16.387248 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG nova.api.openstack.wsgi [None req-9cb2c542-b4fa-49fa-b153-3cc2f0ad0e6d admin admin] Calling method '>' {{(pid=104255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:16:16.388278 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: INFO nova.api.openstack.requestlog [None req-9cb2c542-b4fa-49fa-b153-3cc2f0ad0e6d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Oct 26 11:16:16.388695 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: [pid: 104255|app: 0|req: 37/75] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Oct 26 11:16:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:16:16.577916 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG nova.api.openstack.wsgi [None req-7a2f2790-134d-407e-b2d3-2bf3afb7a7fe admin admin] Calling method '>' {{(pid=104256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:16:16.581963 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_concurrency.lockutils [None req-7a2f2790-134d-407e-b2d3-2bf3afb7a7fe admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:16:16.582432 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_concurrency.lockutils [None req-7a2f2790-134d-407e-b2d3-2bf3afb7a7fe admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:16:16.582878 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_concurrency.lockutils [None req-7a2f2790-134d-407e-b2d3-2bf3afb7a7fe admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:16:16.583594 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_concurrency.lockutils [None req-7a2f2790-134d-407e-b2d3-2bf3afb7a7fe admin admin] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:16:16.584024 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_concurrency.lockutils [None req-7a2f2790-134d-407e-b2d3-2bf3afb7a7fe admin admin] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:16:16.584430 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: DEBUG oslo_concurrency.lockutils [None req-7a2f2790-134d-407e-b2d3-2bf3afb7a7fe admin admin] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:16:16.605711 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: INFO nova.api.openstack.requestlog [None req-7a2f2790-134d-407e-b2d3-2bf3afb7a7fe admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.078143 Oct 26 11:16:16.606190 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: [pid: 104256|app: 0|req: 39/76] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Oct 26 11:16:16 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:17:13.744046 dv-cinder-815582-18-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 26 11:17:13.744968 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: Wed Oct 26 11:17:13 2022 - graceful shutdown triggered... Oct 26 11:17:13.745424 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: Gracefully killing worker 1 (pid: 104255)... Oct 26 11:17:13.745795 dv-cinder-815582-18-iscsi devstack@n-api.service[104256]: Gracefully killing worker 2 (pid: 104256)... Oct 26 11:17:13.873452 dv-cinder-815582-18-iscsi devstack@n-api.service[104255]: DEBUG dbcounter [-] [104255] Writing DB stats nova_api:SELECT=4 {{(pid=104255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:17:14.745577 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: worker 1 buried after 1 seconds Oct 26 11:17:14.745577 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: worker 2 buried after 1 seconds Oct 26 11:17:14.745577 dv-cinder-815582-18-iscsi devstack@n-api.service[104254]: goodbye to uWSGI. Oct 26 11:17:14.746973 dv-cinder-815582-18-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 26 11:17:14.747554 dv-cinder-815582-18-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 26 11:17:14.750305 dv-cinder-815582-18-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 26 11:17:14.764456 dv-cinder-815582-18-iscsi devstack@n-api.service[119286]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 26 11:17:14.765940 dv-cinder-815582-18-iscsi devstack@n-api.service[119286]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 26 11:17:14 2022] *** Oct 26 11:17:14.765940 dv-cinder-815582-18-iscsi devstack@n-api.service[119286]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 26 11:17:14.765940 dv-cinder-815582-18-iscsi devstack@n-api.service[119286]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 26 11:17:14.765940 dv-cinder-815582-18-iscsi devstack@n-api.service[119286]: nodename: dv-cinder-815582-18-iscsi Oct 26 11:17:14.765940 dv-cinder-815582-18-iscsi devstack@n-api.service[119286]: machine: x86_64 Oct 26 11:17:14.765940 dv-cinder-815582-18-iscsi devstack@n-api.service[119286]: clock source: unix Oct 26 11:17:14.765940 dv-cinder-815582-18-iscsi devstack@n-api.service[119286]: pcre jit disabled Oct 26 11:17:14.765940 dv-cinder-815582-18-iscsi devstack@n-api.service[119286]: detected number of CPU cores: 4 Oct 26 11:17:14.765940 dv-cinder-815582-18-iscsi devstack@n-api.service[119286]: current working directory: / Oct 26 11:17:14.765940 dv-cinder-815582-18-iscsi devstack@n-api.service[119286]: detected binary path: /usr/bin/uwsgi-core Oct 26 11:17:14.766636 dv-cinder-815582-18-iscsi devstack@n-api.service[119286]: your processes number limit is 47680 Oct 26 11:17:14.766636 dv-cinder-815582-18-iscsi devstack@n-api.service[119286]: your memory page size is 4096 bytes Oct 26 11:17:14.766636 dv-cinder-815582-18-iscsi devstack@n-api.service[119286]: detected max file descriptor number: 2048 Oct 26 11:17:14.766636 dv-cinder-815582-18-iscsi devstack@n-api.service[119286]: lock engine: pthread robust mutexes Oct 26 11:17:14.766636 dv-cinder-815582-18-iscsi devstack@n-api.service[119286]: thunder lock: enabled Oct 26 11:17:14.766636 dv-cinder-815582-18-iscsi devstack@n-api.service[119286]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 26 11:17:14.766636 dv-cinder-815582-18-iscsi devstack@n-api.service[119286]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 26 11:17:14.806932 dv-cinder-815582-18-iscsi devstack@n-api.service[119286]: Python main interpreter initialized at 0x5596bc6949c0 Oct 26 11:17:14.806932 dv-cinder-815582-18-iscsi devstack@n-api.service[119286]: python threads support enabled Oct 26 11:17:14.806932 dv-cinder-815582-18-iscsi devstack@n-api.service[119286]: your server socket listen backlog is limited to 100 connections Oct 26 11:17:14.806932 dv-cinder-815582-18-iscsi devstack@n-api.service[119286]: your mercy for graceful operations on workers is 90 seconds Oct 26 11:17:14.807455 dv-cinder-815582-18-iscsi devstack@n-api.service[119286]: mapped 403077 bytes (393 KB) for 2 cores Oct 26 11:17:14.807455 dv-cinder-815582-18-iscsi devstack@n-api.service[119286]: *** Operational MODE: preforking *** Oct 26 11:17:14.807676 dv-cinder-815582-18-iscsi devstack@n-api.service[119286]: *** uWSGI is running in multiple interpreter mode *** Oct 26 11:17:14.807676 dv-cinder-815582-18-iscsi devstack@n-api.service[119286]: spawned uWSGI master process (pid: 119286) Oct 26 11:17:14.807885 dv-cinder-815582-18-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 26 11:17:14.808744 dv-cinder-815582-18-iscsi devstack@n-api.service[119286]: spawned uWSGI worker 1 (pid: 119305, cores: 1) Oct 26 11:17:14.808865 dv-cinder-815582-18-iscsi devstack@n-api.service[119286]: spawned uWSGI worker 2 (pid: 119306, cores: 1) Oct 26 11:17:14.809047 dv-cinder-815582-18-iscsi devstack@n-api.service[119286]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 26 11:17:15.465991 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 26 11:17:15.466612 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 26 11:17:16.730857 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 26 11:17:16.730857 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: from cryptography.utils import int_from_bytes Oct 26 11:17:16.730857 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 26 11:17:16.730857 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: from cryptography.utils import int_from_bytes Oct 26 11:17:16.731682 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 26 11:17:16.731682 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: from cryptography.utils import int_from_bytes Oct 26 11:17:16.731682 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 26 11:17:16.731682 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: from cryptography.utils import int_from_bytes Oct 26 11:17:19.144012 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 26 11:17:19.144670 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 26 11:17:19.144789 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 26 11:17:19.145156 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 26 11:17:19.145415 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 26 11:17:19.145809 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.145931 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 26 11:17:19.146289 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 26 11:17:19.146378 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.146459 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.146645 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 26 11:17:19.146748 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.147022 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 26 11:17:19.147133 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.147298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 26 11:17:19.147399 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.147666 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.147792 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.148023 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.148139 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.148345 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.148450 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.148642 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.148746 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.149217 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.149330 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.149537 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.149634 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-18-iscsi {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.149858 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.149964 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.150171 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.150280 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.150488 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.150587 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.150739 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.150928 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.151097 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.151188 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.151418 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-18-iscsi {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.151526 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.151749 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.151916 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.152062 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.152248 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.153804 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.153804 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.154249 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.154478 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.154695 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.154934 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.155160 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.155378 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.155605 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.155605 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.156990 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.157222 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.157429 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.157653 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.157878 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.158101 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.158330 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.158535 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.158740 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.158975 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.159194 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.159380 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-18-iscsi {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.159604 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.159758 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.159950 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.160103 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.160279 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.160434 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.160577 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.160577 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.160885 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.161066 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-18-iscsi {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.161223 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.161367 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.161535 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.161691 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.161864 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.162010 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.162161 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.162161 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.162474 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.162643 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.162788 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.162975 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.163121 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.163273 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.163418 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.163638 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.164403 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.164569 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.164726 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.164923 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.165099 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.165260 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.165423 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.165567 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.165718 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.165870 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.166027 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.166179 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.166333 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.166477 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.166620 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.166762 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.166968 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.167115 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.167276 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.167422 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.167570 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.167714 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.167870 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.168020 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.168173 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.168323 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.168515 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.169229 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.169391 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.169621 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.169778 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.169930 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.170073 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.170219 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.170372 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.170372 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.170943 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.170943 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.171231 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.171375 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.171545 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.171819 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.171990 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.172139 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.172289 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.172441 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.172600 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.172746 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.172900 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.172900 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.173228 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.173380 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.173552 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.173741 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.173931 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.174802 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.174990 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.175147 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.175301 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.175453 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.175605 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.175759 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.175911 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.176065 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.176209 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.176365 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.176508 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.176652 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.176796 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.176952 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.177105 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.177249 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.177399 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.177544 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.177687 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.177840 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.178115 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.178287 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.178445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.178597 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.178749 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.178983 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.179625 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.179783 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.179935 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.179935 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.180221 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.180376 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.180527 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.180677 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.180820 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.180982 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.181139 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.181283 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.181433 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.181577 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.181719 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.181870 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.182246 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.182402 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.182554 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.182698 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.182868 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.183031 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.183193 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.183337 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.183660 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.183864 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.184013 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.184397 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.184843 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.184996 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.185134 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.185287 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.185428 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.185578 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.185728 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.185876 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.186014 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.186150 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.186297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.186449 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.186596 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.186742 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.186907 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.187053 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.187193 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.187193 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.187475 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.187634 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.187787 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.187933 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.188079 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.188223 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.188369 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.188516 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.188663 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.188802 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.188941 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.189088 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.189226 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.189373 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.189528 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.189667 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.189815 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.189963 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.190107 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.190252 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.190392 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.190537 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.190687 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.190846 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.190992 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.191133 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.191280 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.191435 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.191588 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.191728 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.191873 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.192015 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.192114 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.192114 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.192277 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.192362 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.192444 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.192537 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.192621 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.192704 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.192795 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.192885 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.192977 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.193067 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.193160 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.193251 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.193352 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.193442 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.193526 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.193609 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.193700 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.193792 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.193933 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.194025 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.194108 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.194191 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.194295 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.194412 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.194615 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.195118 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.195724 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.195812 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.195904 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.195904 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.196074 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.196157 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.196240 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.196323 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.196413 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.196509 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 26 11:17:19.196614 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.196745 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.196857 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.196965 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.197085 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.197196 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.197306 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.197424 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.197536 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.197645 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.197838 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.197959 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.198069 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.198178 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.198286 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.198401 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.198520 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.198630 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.198748 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.198876 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.199080 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.199199 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.199288 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.199381 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.199483 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.199570 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.199660 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.199744 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.199836 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.199920 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.200011 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.200095 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.200221 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.200320 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.200417 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.200508 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.200599 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.200690 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.200782 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.200866 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.200968 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.201061 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.201145 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.201228 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.201320 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.201404 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.201500 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.201585 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.201674 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.201765 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.201926 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.202027 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.202120 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.202206 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.202296 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.202380 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.202470 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.202566 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.202657 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.202748 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.202896 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.202986 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.203069 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.203170 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.203256 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.203345 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.203435 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.203526 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.203618 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.203710 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.203794 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.203877 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.204020 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.204127 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.204222 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.204307 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.204390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.204474 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.204557 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.204653 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.204742 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.204814 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.205048 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.205341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.205478 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.205567 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.205661 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.205754 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.205872 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.205872 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.206088 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.206199 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.206318 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.206435 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.206435 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.206435 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.206743 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.206872 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.207008 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.207128 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.207247 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.207365 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.207476 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.207597 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.207708 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.207823 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.207943 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.208061 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.208300 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.208476 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.208630 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.208785 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.208936 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.209089 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.209233 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.209390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.209541 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.209683 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.209832 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.209986 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.210137 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.210288 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.210450 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.210594 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.210736 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.210980 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.211146 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.211292 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.211443 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.211596 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.211747 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.212070 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.212219 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.212387 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.212523 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.212703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.212836 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.213026 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.213153 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.213347 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.213470 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.213670 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.213838 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.213990 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.214121 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.214311 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.214404 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.214643 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.214735 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.215195 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.215523 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.215660 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.215798 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.215798 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.216048 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.216191 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.216321 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.216457 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.216593 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.216724 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.216852 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.216990 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.217119 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.217255 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.217393 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.217532 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.217675 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.217819 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.217957 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.218087 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.218215 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.218385 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.218537 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.218698 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.218854 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.219043 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.219175 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.219351 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.219570 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.219702 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.219832 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.219961 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.220096 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.220260 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.220407 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.220572 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.220705 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.220882 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.221021 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.221191 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.221332 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.221500 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.221631 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.221809 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.221951 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.222115 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.222255 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.222422 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.222563 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.222730 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.222918 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.223070 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.223209 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.223340 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.223476 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.223667 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.223976 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.224119 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.224280 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.224412 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.224588 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.224721 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.224894 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.225038 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.225246 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.225382 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.225557 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.225672 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.225874 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.226017 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.226218 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.226318 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.226547 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.226647 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.226887 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.226996 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.227213 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.227314 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.227530 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.227620 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.227844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.227946 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.228161 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.228254 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.228477 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.228570 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.228788 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.228887 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.229110 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.229201 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.229424 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.229515 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.229746 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.229846 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.230062 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.230155 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.230391 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.230491 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.230710 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.230809 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.231063 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.231156 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.231377 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.231483 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.231694 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.231791 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.232010 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.232103 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.232328 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.232433 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.232654 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.232745 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.232969 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.233069 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.233282 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.233386 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.233601 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.233693 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.233914 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.234012 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.234228 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.234331 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.234540 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.234639 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.234881 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.235016 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.235202 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.235347 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.235578 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.235867 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.236002 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.236129 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.236268 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.236406 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.236545 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.236682 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.236812 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.236941 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.237079 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.237216 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.237346 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.237482 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.237636 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.237788 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.237964 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.238108 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.238285 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.238424 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.238599 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.238741 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.238940 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.239081 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.239258 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.239392 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.239569 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.239716 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.239883 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.240024 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.240197 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.240333 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.240503 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.240646 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.240810 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.240952 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.241117 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.241256 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.241433 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.241567 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.242263 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.242395 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.242579 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.242719 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.242969 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.243101 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.243238 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.243376 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.243513 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.243650 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.243792 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.243924 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.244097 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.244240 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.244411 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.244543 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.244737 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.244878 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.245048 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.245185 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.245355 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.245473 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.245682 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.245826 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.246127 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.246248 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.246384 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.246536 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.246666 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.246795 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.246945 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.247076 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.247216 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.247360 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.247490 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.247618 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.247791 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.247924 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.248133 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.248277 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.248446 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.248579 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.248751 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.248892 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.249071 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.249282 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.249413 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.249541 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.249668 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.249797 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.249985 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.250118 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.250295 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.250438 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.250606 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.250748 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.250950 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.251089 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.251228 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.251365 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.251889 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.252035 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.252177 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.252318 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.252448 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.252585 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.252585 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.252847 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.252984 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.253122 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.253259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.253390 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.253526 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.253670 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.253800 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.253936 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.254458 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.254606 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.254737 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.254938 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.255082 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.255220 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.255363 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.255363 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.255580 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.255783 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.255925 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.256144 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.256287 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.256406 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.256635 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.256769 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.256899 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.257030 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.257173 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.257345 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.257480 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.258100 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.258283 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.258424 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.258576 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.258714 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.258918 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.259059 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.259231 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.259359 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.259539 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.259674 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.259845 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.259996 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.260154 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.260286 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.260460 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.260599 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.260768 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.260910 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.261074 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.261207 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.261382 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.261513 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.261686 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.261826 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.261998 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.262131 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.262302 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.262443 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.262607 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.262747 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.262940 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.263074 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.263246 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.263377 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.263559 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.263692 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.263865 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.263998 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.264191 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.264323 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.264504 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.264636 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.264809 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.264959 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.265114 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.265257 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.265417 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.265542 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.265830 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.265975 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.266136 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.266349 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.266483 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.266626 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.266892 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.267042 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.267174 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.267315 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.267446 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.267575 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.267704 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.267833 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.267976 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.268117 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.268256 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.268386 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.268542 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.268674 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.268813 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.268945 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.269089 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.269221 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.269398 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.269533 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.269720 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.269855 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.270034 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.270169 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.270490 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.270623 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.270764 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.270928 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.271068 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.271201 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.271332 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.271461 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.271647 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.271801 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.272038 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.272173 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.272311 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.272451 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.272582 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.272735 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.273494 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.273633 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.273773 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.273919 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.274303 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.274432 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.274568 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.274697 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.274850 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.275006 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.275144 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.275273 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.275402 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.275529 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.275648 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.275778 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.275920 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.276117 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.276251 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.276463 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.276612 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.276744 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.276887 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.277280 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.277501 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.277646 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.277793 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.277937 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.278094 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.278296 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.278421 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.278543 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.278675 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.278859 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.278994 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.279139 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.279270 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.279408 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.279548 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.279668 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.279778 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.279906 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.280050 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.280193 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.280333 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.280465 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.280603 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.280741 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.280885 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.281023 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.281152 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.281281 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.281418 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.281552 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.281694 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.281834 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.281965 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.282102 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.282232 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.282368 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.282511 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.282642 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.282782 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.282941 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.283072 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.283201 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.283405 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.283536 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.283674 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.283806 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.283936 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.284078 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.284217 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.284354 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.284491 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.284625 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.284754 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.284897 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.285028 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.285157 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.285294 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.285424 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.285569 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.285708 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.285842 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.285955 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.286205 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.286351 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.286497 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.286699 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.286877 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.287011 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.287141 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.287285 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.287494 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.287642 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.287774 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.287911 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.288044 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.288182 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.288321 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.288452 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.288609 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.288749 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.288881 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.289011 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.289150 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.289289 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.289435 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.289575 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.289706 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.289835 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.290060 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.290195 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.290326 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.290456 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.290593 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.290724 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.290883 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.291026 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.291159 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.291289 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.291420 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.291608 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.291755 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.291923 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.292058 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.292237 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.292372 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.292549 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.292693 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.292865 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.293008 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.293179 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.293315 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.293489 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.293624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.293803 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.293936 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.294116 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.294251 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.294423 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.294557 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.294730 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.294925 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.295059 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.295198 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.295361 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.295504 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.295665 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.295806 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.295992 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.296307 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.296457 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.296611 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.296836 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.296978 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.297118 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.297262 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.297443 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.297670 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.297811 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.297942 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.298072 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.298388 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.298531 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.298708 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.298867 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.299045 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.299190 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.299412 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.299545 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.299729 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.299863 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.300070 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.300351 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.300669 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.300803 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.300978 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.301122 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.301305 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.301448 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.301621 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.301768 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.301941 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.302085 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.302276 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.302420 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.302590 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.302738 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.302900 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.303033 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.303217 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.303360 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.303543 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.303682 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.303850 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.303984 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.304691 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.304835 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.305120 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.305260 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.305440 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.305582 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.305753 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.305897 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.306110 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.306250 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.306481 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.306618 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.306927 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.307073 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.307207 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.307338 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.307477 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.307635 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.307878 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.308023 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.308162 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.308293 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.308437 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.308570 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.308701 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.308831 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.309018 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.309167 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.309348 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.309483 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.309667 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.309801 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.309988 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.310136 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.310303 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.310439 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.310627 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.310761 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.311104 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.311342 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.311570 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.311791 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.312023 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.312257 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.312428 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.312583 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.312798 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.312933 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.313072 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.313205 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.313419 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.313630 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.313764 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.313895 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.314034 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.314175 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.314321 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.314460 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.314598 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.314730 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.314892 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.315036 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.315175 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.315316 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.315447 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.315577 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.315708 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.315838 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.315978 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.316118 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.316240 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.316377 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.316596 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.316745 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.316878 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.317021 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.317233 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.317365 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.317495 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.317635 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.317767 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.317922 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.318142 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.318285 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.318418 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.318559 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.318699 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.318860 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.318993 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.319135 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.319267 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.319408 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.319540 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.319678 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.319894 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.320031 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.320176 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.320816 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.320948 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.321094 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.321226 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.321363 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.321504 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.321636 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.321813 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.321948 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.322123 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.322266 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.322429 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.322575 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.322772 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.322946 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.323108 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.323252 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.323434 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.323570 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.323769 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.323908 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.324101 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.324249 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.324415 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.324550 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.324750 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.324886 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.325080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.325227 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.325390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.325531 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.325702 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.325845 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.326018 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.326160 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.326326 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.326470 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.326642 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.326785 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.326974 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.327105 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.327290 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.327419 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.327598 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.327742 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.327885 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.328024 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.328202 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.328316 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.328513 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.328619 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.328821 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.328926 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.329124 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.329227 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.329429 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.329531 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.329743 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.329837 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.330050 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.330143 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.330354 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.330448 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.330672 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.330766 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.331005 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.331103 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.331312 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.331421 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.331615 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.331717 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.331964 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.332060 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.332271 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.332371 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.332602 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.332704 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.332912 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.333008 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.333238 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.333339 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.333552 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.333659 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.333868 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.333984 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.334188 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.334305 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.334500 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.334604 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.334831 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.334945 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.335161 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.335263 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.335511 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.335613 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.335840 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.336054 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.336159 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.336419 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.336536 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.336706 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.336797 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.337027 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.337287 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.337385 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.337618 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.337740 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.337934 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.338037 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.338251 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.338356 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.338567 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.338670 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.338901 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.339022 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.339217 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.339319 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.339532 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.339627 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.339846 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.339956 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.340159 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.340254 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.340473 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.340569 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.340805 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.340913 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.341133 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.341228 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.341453 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.341560 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.341777 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.341884 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.342102 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.342204 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.342423 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.342526 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.342742 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.342855 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.343090 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.343193 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.343410 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.343519 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.343728 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.343831 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.344044 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.344138 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.344362 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.344476 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.344675 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.344771 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.344991 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.345133 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.345304 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.345399 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.345618 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.345721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.345932 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.346026 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.346250 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.346351 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.346563 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.346678 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.346895 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.347008 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.347214 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.347311 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.347531 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.347627 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.347851 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.347953 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.348170 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.348272 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.348495 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.348702 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.348804 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.349037 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.349133 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.349381 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.349475 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.349720 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.349921 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.350057 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.350240 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.350384 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.350577 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.350733 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.350934 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.351585 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.351787 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.351904 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.352108 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.352211 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.352428 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.352523 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.352759 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.352855 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.353069 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.353163 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.353375 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.353471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.353686 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.353788 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.353997 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.354100 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.354302 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.354419 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.354630 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.354736 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.354964 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.355201 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.355315 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.355558 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.355661 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.355879 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.355972 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.356240 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.356412 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.356575 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.356791 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.356896 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.357075 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.357180 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.357408 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.357511 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.357740 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.357848 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.358061 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.358165 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.358371 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.358466 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.358700 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.358803 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.359034 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.359147 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.359343 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.359445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.359658 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.359751 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.359970 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.360072 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.360277 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.360374 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.360585 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.360687 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.360892 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.360986 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.361202 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.361333 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.361511 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.361639 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.361822 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.361916 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.362125 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.362219 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.362438 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.362531 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.362748 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.362864 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.363081 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.363184 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.363391 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.363498 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.363702 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.363804 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.364005 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.364099 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.364312 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.364419 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.364631 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.364766 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.364923 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.365019 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.365237 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.365340 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.365543 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.365645 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.365854 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.365949 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.366160 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.366267 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.366472 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.366564 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.367387 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.367530 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.367684 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.367781 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.367995 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.368096 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.368314 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.368416 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.368620 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.368730 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.368929 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.369036 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.369248 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.369350 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.369564 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.369660 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.369890 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.369993 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.370209 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.370432 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.370540 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.370774 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.370903 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.371129 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.371224 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.371473 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.371709 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.371813 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.372050 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.372209 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.372376 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.372486 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.372703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.372804 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.373036 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.373138 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.373345 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.373512 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.373654 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.373757 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.373961 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.374066 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.374291 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.374386 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.374606 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.374701 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.374956 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.375057 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.375273 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.375369 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.375585 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.375680 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.375898 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.375992 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.376207 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.376302 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.376520 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.376614 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.376832 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.376929 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.377142 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.377238 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.377494 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.377635 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.377758 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.377907 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.378069 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.378166 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.378388 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.378498 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.378690 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.378800 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.379030 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.379140 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.379367 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.379475 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.379685 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.379789 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.380002 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.380097 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.380316 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.380410 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.380628 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.380723 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.380938 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.381032 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.381251 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.381347 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.381563 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.381664 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.381871 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.381974 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.382187 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.382369 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.382588 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.382685 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.382929 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.383041 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.383238 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.383342 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.383658 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.383752 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.383971 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.384072 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.384294 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.384404 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.384609 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.384702 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.384919 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.385019 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.385242 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.385345 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.385566 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.385669 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.385879 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.385982 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.386201 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.386297 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.386515 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.386611 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.386864 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.386972 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.387178 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.387273 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.387490 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.387706 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.387852 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.387993 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.388118 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.388214 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.388432 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.388536 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.388738 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.388840 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.389047 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.389145 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.389361 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.389456 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.389668 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.389771 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.389972 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.390065 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.390277 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.390379 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.390583 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.390690 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.390906 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.391017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.391213 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.391309 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.391515 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.391618 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.391820 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.391925 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.392127 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.392222 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.392428 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.392522 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.392735 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.392842 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.393037 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.393131 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.393340 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.393443 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.393641 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.393744 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.393943 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.394089 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.394249 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.394345 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.394549 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.394650 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.394878 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.395018 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.395186 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.395292 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.395488 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.395591 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.395790 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.395894 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.396123 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.396219 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.396458 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.396565 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.396776 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.396885 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.397100 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.397194 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.397410 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.397513 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.397745 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.397899 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.398173 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.398272 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.398516 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.398612 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.398856 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.399269 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.399446 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.399551 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.399758 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.399853 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.400074 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.400177 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.400390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.400485 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.400701 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.400796 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.401017 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.401114 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.401329 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.401432 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.401641 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.401736 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.401966 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.402108 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.402281 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.402386 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.402608 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.402784 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.402964 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.403065 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.403285 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.403391 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.403605 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.403709 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.403921 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.404016 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.404237 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.404347 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.404547 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.404655 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.404860 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.404954 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.405175 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.405281 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.405483 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.405578 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.405794 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.405890 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.406105 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.406200 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.406415 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.406512 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.406731 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.406847 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.407069 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.407170 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.407381 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.407485 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.407699 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.407849 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.408022 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.408153 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.408355 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.408451 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.408679 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.408786 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.408989 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.409099 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.409318 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.409428 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.409649 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.409764 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.409970 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.410075 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.410291 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.410387 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.410609 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.410705 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.410874 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 26 11:17:19.410997 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.411282 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.411596 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.411905 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 26 11:17:19.412149 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 26 11:17:19.472837 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO dbcounter [None req-6b3d1eff-34e6-48b9-8b6a-bb08ff4fc6e5 None None] Registered counter for database nova_api Oct 26 11:17:19.473717 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO dbcounter [None req-ceacef08-dfeb-4241-a5f2-41ecce739465 None None] Registered counter for database nova_api Oct 26 11:17:19.494134 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_db.sqlalchemy.engines [None req-6b3d1eff-34e6-48b9-8b6a-bb08ff4fc6e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 11:17:19.496124 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_db.sqlalchemy.engines [None req-ceacef08-dfeb-4241-a5f2-41ecce739465 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 11:17:19.501030 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writer thread running {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 11:17:19.503111 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writer thread running {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 11:17:19.558431 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.context [None req-6b3d1eff-34e6-48b9-8b6a-bb08ff4fc6e5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7411e83a-2967-480a-988d-f63e6d8f34bf(cell1) {{(pid=119305) load_cells /opt/stack/nova/nova/context.py:464}} Oct 26 11:17:19.560799 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.context [None req-ceacef08-dfeb-4241-a5f2-41ecce739465 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7411e83a-2967-480a-988d-f63e6d8f34bf(cell1) {{(pid=119306) load_cells /opt/stack/nova/nova/context.py:464}} Oct 26 11:17:19.562460 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6b3d1eff-34e6-48b9-8b6a-bb08ff4fc6e5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:17:19.563041 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6b3d1eff-34e6-48b9-8b6a-bb08ff4fc6e5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:17:19.564634 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6b3d1eff-34e6-48b9-8b6a-bb08ff4fc6e5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:17:19.564801 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ceacef08-dfeb-4241-a5f2-41ecce739465 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:17:19.565282 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ceacef08-dfeb-4241-a5f2-41ecce739465 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:17:19.565376 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6b3d1eff-34e6-48b9-8b6a-bb08ff4fc6e5 None None] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:17:19.565799 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6b3d1eff-34e6-48b9-8b6a-bb08ff4fc6e5 None None] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:17:19.566912 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ceacef08-dfeb-4241-a5f2-41ecce739465 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:17:19.567642 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ceacef08-dfeb-4241-a5f2-41ecce739465 None None] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:17:19.567838 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6b3d1eff-34e6-48b9-8b6a-bb08ff4fc6e5 None None] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:17:19.568096 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ceacef08-dfeb-4241-a5f2-41ecce739465 None None] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:17:19.569867 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO dbcounter [None req-6b3d1eff-34e6-48b9-8b6a-bb08ff4fc6e5 None None] Registered counter for database nova_cell0 Oct 26 11:17:19.570193 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ceacef08-dfeb-4241-a5f2-41ecce739465 None None] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:17:19.572252 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO dbcounter [None req-ceacef08-dfeb-4241-a5f2-41ecce739465 None None] Registered counter for database nova_cell0 Oct 26 11:17:19.574105 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO dbcounter [None req-6b3d1eff-34e6-48b9-8b6a-bb08ff4fc6e5 None None] Registered counter for database nova_cell1 Oct 26 11:17:19.576394 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO dbcounter [None req-ceacef08-dfeb-4241-a5f2-41ecce739465 None None] Registered counter for database nova_cell1 Oct 26 11:17:19.581821 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_db.sqlalchemy.engines [None req-6b3d1eff-34e6-48b9-8b6a-bb08ff4fc6e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 11:17:19.583875 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_db.sqlalchemy.engines [None req-6b3d1eff-34e6-48b9-8b6a-bb08ff4fc6e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 11:17:19.585975 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_db.sqlalchemy.engines [None req-ceacef08-dfeb-4241-a5f2-41ecce739465 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 11:17:19.587704 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_db.sqlalchemy.engines [None req-ceacef08-dfeb-4241-a5f2-41ecce739465 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 11:17:19.591008 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writer thread running {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 11:17:19.591358 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writer thread running {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 11:17:19.594562 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writer thread running {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 11:17:19.595060 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writer thread running {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 11:17:19.744821 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO dbcounter [None req-6b3d1eff-34e6-48b9-8b6a-bb08ff4fc6e5 None None] Registered counter for database nova_cell0 Oct 26 11:17:19.745315 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO dbcounter [None req-ceacef08-dfeb-4241-a5f2-41ecce739465 None None] Registered counter for database nova_cell0 Oct 26 11:17:19.753959 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_db.sqlalchemy.engines [None req-ceacef08-dfeb-4241-a5f2-41ecce739465 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 11:17:19.757118 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_db.sqlalchemy.engines [None req-6b3d1eff-34e6-48b9-8b6a-bb08ff4fc6e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 26 11:17:19.759317 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writer thread running {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 11:17:19.761738 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writer thread running {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 26 11:17:20.084583 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: WARNING keystonemiddleware.auth_token [None req-6b3d1eff-34e6-48b9-8b6a-bb08ff4fc6e5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 26 11:17:20.086135 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: WARNING keystonemiddleware.auth_token [None req-ceacef08-dfeb-4241-a5f2-41ecce739465 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 26 11:17:20.091923 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: WARNING keystonemiddleware.auth_token [None req-6b3d1eff-34e6-48b9-8b6a-bb08ff4fc6e5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 26 11:17:20.093653 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: WARNING keystonemiddleware.auth_token [None req-ceacef08-dfeb-4241-a5f2-41ecce739465 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 26 11:17:20.438328 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: WARNING keystonemiddleware.auth_token [None req-6b3d1eff-34e6-48b9-8b6a-bb08ff4fc6e5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 26 11:17:20.439624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: WARNING keystonemiddleware.auth_token [None req-ceacef08-dfeb-4241-a5f2-41ecce739465 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 26 11:17:20.444407 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: WARNING keystonemiddleware.auth_token [None req-6b3d1eff-34e6-48b9-8b6a-bb08ff4fc6e5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 26 11:17:20.446201 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: WARNING keystonemiddleware.auth_token [None req-ceacef08-dfeb-4241-a5f2-41ecce739465 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 26 11:17:20.450258 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5596bc6949c0 pid: 119305 (default app) Oct 26 11:17:20.451782 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5596bc6949c0 pid: 119306 (default app) Oct 26 11:17:55.971630 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_api:SELECT=3 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:17:55.971630 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell0:SELECT=3 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:17:55.971630 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=3 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:17:55.971630 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell0:SELECT=3 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:17:57.366881 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-9c4ec376-5080-427d-8ce9-54638302eccf tempest-VolumesGetTestJSON-1954452249 tempest-VolumesGetTestJSON-1954452249-project] Action: 'create', calling method: .version_select at 0x7f6b94792ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-369254259", "metadata": {"Type": "work"}}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:18:00.036537 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-9c4ec376-5080-427d-8ce9-54638302eccf tempest-VolumesGetTestJSON-1954452249 tempest-VolumesGetTestJSON-1954452249-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.078460 Oct 26 11:18:00.047100 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1156 bytes} [Wed Oct 26 11:17:55 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4081 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 26 11:18:00.303724 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-a425fa01-1093-483d-bcbf-784df29bfbdc tempest-VolumesGetTestJSON-1954452249 tempest-VolumesGetTestJSON-1954452249-project] Calling method '.version_select at 0x7f6b947f90d0>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:00.339794 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=3 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:00.341041 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell0:SELECT=3 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:00.342194 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=3 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:00.344160 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell0:SELECT=3 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:01.232206 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-a425fa01-1093-483d-bcbf-784df29bfbdc tempest-VolumesGetTestJSON-1954452249 tempest-VolumesGetTestJSON-1954452249-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f7c1f921-5403-423d-85da-7918dbe7e52f" status: 200 len: 352 microversion: 2.1 time: 1.182078 Oct 26 11:18:01.233090 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 1/2] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Oct 26 11:18:00 2022] GET /compute/v2.1/os-volumes/f7c1f921-5403-423d-85da-7918dbe7e52f => generated 352 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:18:02.248363 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-ffa72b84-00e4-41a9-abff-d07d77e528a1 tempest-VolumesGetTestJSON-1954452249 tempest-VolumesGetTestJSON-1954452249-project] Calling method '.version_select at 0x7f6b9461ad30>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:02.379676 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-ffa72b84-00e4-41a9-abff-d07d77e528a1 tempest-VolumesGetTestJSON-1954452249 tempest-VolumesGetTestJSON-1954452249-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f7c1f921-5403-423d-85da-7918dbe7e52f" status: 200 len: 353 microversion: 2.1 time: 0.135975 Oct 26 11:18:02.381786 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Oct 26 11:18:02 2022] GET /compute/v2.1/os-volumes/f7c1f921-5403-423d-85da-7918dbe7e52f => generated 353 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:18:02.403057 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-74edcd63-6aaa-4c90-b97c-9efe28042f4c tempest-VolumesGetTestJSON-1954452249 tempest-VolumesGetTestJSON-1954452249-project] Calling method '.version_select at 0x7f6b9464ca60>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:03.516869 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-74edcd63-6aaa-4c90-b97c-9efe28042f4c tempest-VolumesGetTestJSON-1954452249 tempest-VolumesGetTestJSON-1954452249-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f7c1f921-5403-423d-85da-7918dbe7e52f" status: 200 len: 353 microversion: 2.1 time: 1.118813 Oct 26 11:18:03.517870 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Oct 26 11:18:02 2022] GET /compute/v2.1/os-volumes/f7c1f921-5403-423d-85da-7918dbe7e52f => generated 353 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:18:03.532496 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-901ae4b8-72fb-46c3-b523-2dcf00866c7c tempest-VolumesGetTestJSON-1954452249 tempest-VolumesGetTestJSON-1954452249-project] Calling method '.version_select at 0x7f6b945ae430>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:04.008244 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-901ae4b8-72fb-46c3-b523-2dcf00866c7c tempest-VolumesGetTestJSON-1954452249 tempest-VolumesGetTestJSON-1954452249-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/f7c1f921-5403-423d-85da-7918dbe7e52f" status: 202 len: 0 microversion: 2.1 time: 0.479930 Oct 26 11:18:04.009102 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 3/5] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Oct 26 11:18:03 2022] DELETE /compute/v2.1/os-volumes/f7c1f921-5403-423d-85da-7918dbe7e52f => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 11:18:04.017245 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-58a5fabc-29b8-40d0-a92e-f6d48c2fda9d tempest-VolumesGetTestJSON-1954452249 tempest-VolumesGetTestJSON-1954452249-project] Calling method '.version_select at 0x7f6b9464cdc0>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:04.106953 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-58a5fabc-29b8-40d0-a92e-f6d48c2fda9d tempest-VolumesGetTestJSON-1954452249 tempest-VolumesGetTestJSON-1954452249-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f7c1f921-5403-423d-85da-7918dbe7e52f" status: 200 len: 352 microversion: 2.1 time: 0.088036 Oct 26 11:18:04.106953 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 3/6] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Oct 26 11:18:04 2022] GET /compute/v2.1/os-volumes/f7c1f921-5403-423d-85da-7918dbe7e52f => generated 352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:18:05.127059 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-c24aecfc-5ddd-4404-9222-42edd04d6d6d tempest-VolumesGetTestJSON-1954452249 tempest-VolumesGetTestJSON-1954452249-project] Calling method '.version_select at 0x7f6b945aeaf0>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:05.335521 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-c24aecfc-5ddd-4404-9222-42edd04d6d6d tempest-VolumesGetTestJSON-1954452249 tempest-VolumesGetTestJSON-1954452249-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f7c1f921-5403-423d-85da-7918dbe7e52f" status: 200 len: 352 microversion: 2.1 time: 0.218098 Oct 26 11:18:05.336696 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Oct 26 11:18:05 2022] GET /compute/v2.1/os-volumes/f7c1f921-5403-423d-85da-7918dbe7e52f => generated 352 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:18:06.352307 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-4bc7e1ac-edd3-419e-ae98-931731b26352 tempest-VolumesGetTestJSON-1954452249 tempest-VolumesGetTestJSON-1954452249-project] Calling method '.version_select at 0x7f6b945f25e0>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:06.410460 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.wsgi [None req-4bc7e1ac-edd3-419e-ae98-931731b26352 tempest-VolumesGetTestJSON-1954452249 tempest-VolumesGetTestJSON-1954452249-project] HTTP exception thrown: Volume f7c1f921-5403-423d-85da-7918dbe7e52f could not be found. Oct 26 11:18:06.417240 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-4bc7e1ac-edd3-419e-ae98-931731b26352 tempest-VolumesGetTestJSON-1954452249 tempest-VolumesGetTestJSON-1954452249-project] Request method failure captured: Oct 26 11:18:06.417240 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: request: GET /compute/v2.1/os-volumes/f7c1f921-5403-423d-85da-7918dbe7e52f HTTP/1.1 Oct 26 11:18:06.417240 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept: application/json Oct 26 11:18:06.417240 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept-Encoding: identity Oct 26 11:18:06.417240 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Connection: close Oct 26 11:18:06.417240 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Length: 0 Oct 26 11:18:06.417240 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Type: application/json Oct 26 11:18:06.417240 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Host: 10.222.0.42 Oct 26 11:18:06.417240 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Openstack-System-Scope: None Oct 26 11:18:06.417240 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: User-Agent: python-urllib3/1.26.12 Oct 26 11:18:06.417240 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Auth-Token: gAAAAABjWRdjj1-d9QW45GW-bS5QQlqLsBvmnP4AJ94dBW74W4X3avgf5qLpRX5TbdQC-nEeNustUkabToO567jdsv-J-mG1QjPSC7-tRf884Gm84wiZaF2KO1tYsV3SauLmy8HkKgGGHpef1V4w4IDSHHkAE_mDE-wXgEUqzi3U-BHEdfgVD98 Oct 26 11:18:06.417240 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Id: None Oct 26 11:18:06.417240 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Name: None Oct 26 11:18:06.417240 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Identity-Status: Confirmed Oct 26 11:18:06.417240 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Is-Admin-Project: True Oct 26 11:18:06.417240 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Id: default Oct 26 11:18:06.417240 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Name: Default Oct 26 11:18:06.417240 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Id: 076d5555468141fb8835eb9dc9317671 Oct 26 11:18:06.417240 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Name: tempest-VolumesGetTestJSON-1954452249 Oct 26 11:18:06.417240 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Role: member,reader Oct 26 11:18:06.417240 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Roles: member,reader Oct 26 11:18:06.418693 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_076d5555468141fb8835eb9dc9317671", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/076d5555468141fb8835eb9dc9317671"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/076d5555468141fb8835eb9dc9317671"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/076d5555468141fb8835eb9dc9317671"}]}] Oct 26 11:18:06.418693 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant: tempest-VolumesGetTestJSON-1954452249 Oct 26 11:18:06.418693 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Id: 076d5555468141fb8835eb9dc9317671 Oct 26 11:18:06.418693 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Name: tempest-VolumesGetTestJSON-1954452249 Oct 26 11:18:06.418693 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User: tempest-VolumesGetTestJSON-1954452249-project Oct 26 11:18:06.418693 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Id: default Oct 26 11:18:06.418693 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Name: Default Oct 26 11:18:06.418693 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Id: eb2f97e51a444736be06322347085cbb Oct 26 11:18:06.418693 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Name: tempest-VolumesGetTestJSON-1954452249-project Oct 26 11:18:06.418693 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: method: Oct 26 11:18:06.418693 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: exception: Volume f7c1f921-5403-423d-85da-7918dbe7e52f could not be found. Oct 26 11:18:06.418693 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: action_args: {'id': 'f7c1f921-5403-423d-85da-7918dbe7e52f'} Oct 26 11:18:06.418693 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:18:06.419639 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:18:06.419639 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 11:18:06.419639 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 11:18:06.419639 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 26 11:18:06.419639 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 26 11:18:06.419639 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 26 11:18:06.419639 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 26 11:18:06.419639 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 11:18:06.419639 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 11:18:06.419639 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 11:18:06.419639 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 11:18:06.419639 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 11:18:06.419639 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 11:18:06.419639 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 11:18:06.419639 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 11:18:06.419639 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f7c1f921-5403-423d-85da-7918dbe7e52f could not be found. (HTTP 404) (Request-ID: req-1dbcc869-ffca-4075-a99f-cd0974423ec1) Oct 26 11:18:06.419639 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:18:06.419639 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:18:06.419639 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:18:06.420802 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:18:06.420802 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 26 11:18:06.420802 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 26 11:18:06.420802 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 26 11:18:06.420802 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 26 11:18:06.420802 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 26 11:18:06.420802 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 26 11:18:06.420802 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 26 11:18:06.420802 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 26 11:18:06.420802 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 11:18:06.420802 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 11:18:06.420802 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 26 11:18:06.420802 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 26 11:18:06.420802 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 26 11:18:06.420802 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 26 11:18:06.420802 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 11:18:06.420802 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 11:18:06.420802 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 11:18:06.420802 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 11:18:06.422509 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 11:18:06.422509 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 11:18:06.422509 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 11:18:06.422509 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 11:18:06.422509 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f7c1f921-5403-423d-85da-7918dbe7e52f could not be found. Oct 26 11:18:06.422509 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:18:06.422509 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:18:06.422509 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:18:06.422509 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:18:06.422509 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:18:06.422509 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:18:06.422509 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:18:06.422509 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:18:06.422509 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 11:18:06.422509 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 11:18:06.422509 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:18:06.422509 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:18:06.422509 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 26 11:18:06.422509 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:18:06.425499 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f7c1f921-5403-423d-85da-7918dbe7e52f could not be found. Oct 26 11:18:06.425499 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:18:06.425499 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:18:06.425499 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:18:06.425499 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:18:06.425499 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:18:06.425499 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:18:06.425499 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:18:06.425499 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:18:06.425499 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f7c1f921-5403-423d-85da-7918dbe7e52f could not be found. Oct 26 11:18:06.425499 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:18:06.425499 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-4bc7e1ac-edd3-419e-ae98-931731b26352 tempest-VolumesGetTestJSON-1954452249 tempest-VolumesGetTestJSON-1954452249-project] Returning 404 to user: Volume f7c1f921-5403-423d-85da-7918dbe7e52f could not be found. {{(pid=119306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:18:06.425499 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-4bc7e1ac-edd3-419e-ae98-931731b26352 tempest-VolumesGetTestJSON-1954452249 tempest-VolumesGetTestJSON-1954452249-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f7c1f921-5403-423d-85da-7918dbe7e52f" status: 404 len: 109 microversion: 2.1 time: 0.074584 Oct 26 11:18:06.425499 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Oct 26 11:18:06 2022] GET /compute/v2.1/os-volumes/f7c1f921-5403-423d-85da-7918dbe7e52f => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:18:08.327065 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-f9ed1691-d5ad-4e40-ad51-4c629f98d97e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Action: 'create', calling method: .version_select at 0x7f6b9461adc0>, body: {"keypair": {"name": "tempest-keypair-283898050", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/goqgMFVcBovkqiZ4gye0I2I+wvDMicYTdGIScDabVKNu1EBGwE1aNr7UPiQpV1RcUS0dJUqTG5TnCdlDA7+/9Nl3vQERmTKenxIhNRhQ215z1QPS3n1rlVXn4RH0QTQ=="}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:18:08.410669 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.quota [None req-f9ed1691-d5ad-4e40-ad51-4c629f98d97e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Getting quotas for project ab29bf15969d46da9670efa2b52e6676. Resources: {'key_pairs'} {{(pid=119305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:18:08.420508 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.quota [None req-f9ed1691-d5ad-4e40-ad51-4c629f98d97e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Getting quotas for user 41276c93e476436791b89ab8a0d4537d and project ab29bf15969d46da9670efa2b52e6676. Resources: {'key_pairs'} {{(pid=119305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:18:08.629916 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-f9ed1691-d5ad-4e40-ad51-4c629f98d97e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.626222 Oct 26 11:18:08.630771 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 5/9] 10.222.0.42 () {62 vars in 1200 bytes} [Wed Oct 26 11:18:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 628 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 26 11:18:09.888807 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e5114c00-8c6a-4cb0-b1c0-ceb36119468c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1126038101", "imageRef": "ed8b5733-339c-4fa7-9767-abef514cb9f2", "flavorRef": "452", "networks": [{"uuid": "82a93ae2-3083-47e4-a693-201ca81c9c17"}]}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:18:10.193275 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.network.neutron [None req-e5114c00-8c6a-4cb0-b1c0-ceb36119468c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] validate_networks() for [('82a93ae2-3083-47e4-a693-201ca81c9c17', None, None, None, None, None)] {{(pid=119306) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 11:18:12.817041 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-c3aa5230-59bd-41a7-bb42-657212ac3aa8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Action: 'create', calling method: .version_select at 0x7f6b9458fe50>, body: {"keypair": {"name": "tempest-keypair-1171470675", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZWiI4ZotTMtMMg43/onN4VY2+QUlHDULVb1eFZ0TJcXLvzfqdIB59bgnoRjOcABIIqfaOquGM6a7t2h0ErxF46yB8weXbFOpQcCVQQQrpd3wh7cWe9ke9MKB1xGvW9LA=="}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:18:12.854774 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.quota [None req-c3aa5230-59bd-41a7-bb42-657212ac3aa8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Getting quotas for project 724121c2144843b7adc7e17312613c9d. Resources: {'key_pairs'} {{(pid=119305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:18:12.867329 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.quota [None req-c3aa5230-59bd-41a7-bb42-657212ac3aa8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Getting quotas for user e031dd9da25146eebb8813dc8bad8b85 and project 724121c2144843b7adc7e17312613c9d. Resources: {'key_pairs'} {{(pid=119305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:18:12.997414 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-c3aa5230-59bd-41a7-bb42-657212ac3aa8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.398881 Oct 26 11:18:12.998475 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 6/10] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Oct 26 11:18:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:18:13.391511 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-e5114c00-8c6a-4cb0-b1c0-ceb36119468c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Flavor limits 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 11:18:13.393094 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-e5114c00-8c6a-4cb0-b1c0-ceb36119468c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Image limits 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 11:18:13.393747 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-e5114c00-8c6a-4cb0-b1c0-ceb36119468c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Flavor pref 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 11:18:13.399890 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-e5114c00-8c6a-4cb0-b1c0-ceb36119468c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Image pref 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 11:18:13.399890 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-e5114c00-8c6a-4cb0-b1c0-ceb36119468c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 11:18:13.424481 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e5114c00-8c6a-4cb0-b1c0-ceb36119468c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:13.425040 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e5114c00-8c6a-4cb0-b1c0-ceb36119468c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:13.426604 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e5114c00-8c6a-4cb0-b1c0-ceb36119468c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:13.426604 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e5114c00-8c6a-4cb0-b1c0-ceb36119468c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:13.428433 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e5114c00-8c6a-4cb0-b1c0-ceb36119468c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:13.429302 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e5114c00-8c6a-4cb0-b1c0-ceb36119468c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:13.530950 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-e5114c00-8c6a-4cb0-b1c0-ceb36119468c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Getting quotas for project 2375e01650824224b673bea3d06af9eb. Resources: {'cores', 'instances', 'ram'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:18:13.543430 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-e5114c00-8c6a-4cb0-b1c0-ceb36119468c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Getting quotas for user fbbd63f10220465c996e6c706f1ef4a9 and project 2375e01650824224b673bea3d06af9eb. Resources: {'cores', 'instances', 'ram'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:18:13.589061 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-e5114c00-8c6a-4cb0-b1c0-ceb36119468c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Going to run 1 instances... {{(pid=119306) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 11:18:13.598377 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-e5114c00-8c6a-4cb0-b1c0-ceb36119468c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed8b5733-339c-4fa7-9767-abef514cb9f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119306) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 11:18:13.994186 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-e5114c00-8c6a-4cb0-b1c0-ceb36119468c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.479665 Oct 26 11:18:13.994186 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 5/11] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Oct 26 11:18:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 4483 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 11:18:14.023133 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-4ed8839a-a259-451b-83ed-96006a0cb773 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:14.023133 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-4ed8839a-a259-451b-83ed-96006a0cb773 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:14.111421 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-4ed8839a-a259-451b-83ed-96006a0cb773 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:14.136299 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-4ed8839a-a259-451b-83ed-96006a0cb773 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1215 microversion: 2.1 time: 0.257176 Oct 26 11:18:14.137478 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 7/12] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:13 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1215 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:15.161536 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e51ebea6-b3c0-4aa6-9e24-b810bcaf04b7 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:15.162215 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-e51ebea6-b3c0-4aa6-9e24-b810bcaf04b7 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:15.509895 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-e51ebea6-b3c0-4aa6-9e24-b810bcaf04b7 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:15.552461 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-e51ebea6-b3c0-4aa6-9e24-b810bcaf04b7 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1215 microversion: 2.1 time: 0.395466 Oct 26 11:18:15.553061 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 6/13] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:15 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1215 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:16.239487 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-cf5f75a4-154e-4be1-a4c7-6e329d49ed41 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2011425814", "imageRef": "ed8b5733-339c-4fa7-9767-abef514cb9f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8a84e861-89f8-4687-9444-98b50729a58f"}], "security_groups": [{"name": "tempest-securitygroup--440821811"}], "key_name": "tempest-keypair-283898050", "user_data": "}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:18:16.542682 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-a27811bc-a9ef-4ef6-ad2b-1178ad043823 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-182249341", "imageRef": "ed8b5733-339c-4fa7-9767-abef514cb9f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:18:16.605947 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.network.neutron [None req-a27811bc-a9ef-4ef6-ad2b-1178ad043823 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] validate_networks() for [('0038bdd3-d1fb-456c-a8d4-41f13af7a1c5', None, None, None, None, None)] {{(pid=119306) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 11:18:16.624912 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.network.neutron [None req-cf5f75a4-154e-4be1-a4c7-6e329d49ed41 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] validate_networks() for [('8a84e861-89f8-4687-9444-98b50729a58f', None, None, None, None, None)] {{(pid=119305) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 11:18:17.301566 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-a27811bc-a9ef-4ef6-ad2b-1178ad043823 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Flavor limits 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 11:18:17.302068 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-a27811bc-a9ef-4ef6-ad2b-1178ad043823 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Image limits 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 11:18:17.302553 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-a27811bc-a9ef-4ef6-ad2b-1178ad043823 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Flavor pref 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 11:18:17.303157 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-a27811bc-a9ef-4ef6-ad2b-1178ad043823 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Image pref 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 11:18:17.303588 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-a27811bc-a9ef-4ef6-ad2b-1178ad043823 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 11:18:17.312921 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a27811bc-a9ef-4ef6-ad2b-1178ad043823 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:17.313636 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a27811bc-a9ef-4ef6-ad2b-1178ad043823 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:17.314215 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a27811bc-a9ef-4ef6-ad2b-1178ad043823 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:17.315722 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a27811bc-a9ef-4ef6-ad2b-1178ad043823 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:17.316412 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a27811bc-a9ef-4ef6-ad2b-1178ad043823 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:17.321930 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a27811bc-a9ef-4ef6-ad2b-1178ad043823 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:17.340738 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-a27811bc-a9ef-4ef6-ad2b-1178ad043823 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Getting quotas for project 9d9d2ce62fb74bdb8de53bc06b1a999d. Resources: {'cores', 'instances', 'ram'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:18:17.351429 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-a27811bc-a9ef-4ef6-ad2b-1178ad043823 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Getting quotas for user ff0c5f8521534fc1a0a9c5ea28fbaac1 and project 9d9d2ce62fb74bdb8de53bc06b1a999d. Resources: {'cores', 'instances', 'ram'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:18:17.368312 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-a27811bc-a9ef-4ef6-ad2b-1178ad043823 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Going to run 1 instances... {{(pid=119306) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 11:18:17.370926 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-a27811bc-a9ef-4ef6-ad2b-1178ad043823 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed8b5733-339c-4fa7-9767-abef514cb9f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119306) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 11:18:17.565972 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-a27811bc-a9ef-4ef6-ad2b-1178ad043823 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.078754 Oct 26 11:18:17.567738 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 7/14] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Oct 26 11:18:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 1082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 11:18:17.592431 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-487c5189-a732-494f-8efc-b4c8dabd45e5 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:17.594028 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-487c5189-a732-494f-8efc-b4c8dabd45e5 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:17.604203 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-487c5189-a732-494f-8efc-b4c8dabd45e5 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:17.604927 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-487c5189-a732-494f-8efc-b4c8dabd45e5 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:17.605514 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-487c5189-a732-494f-8efc-b4c8dabd45e5 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:17.607049 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-487c5189-a732-494f-8efc-b4c8dabd45e5 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:17.607801 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-487c5189-a732-494f-8efc-b4c8dabd45e5 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:17.608396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-487c5189-a732-494f-8efc-b4c8dabd45e5 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:17.789322 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-487c5189-a732-494f-8efc-b4c8dabd45e5 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:17.816576 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-487c5189-a732-494f-8efc-b4c8dabd45e5 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1267 microversion: 2.1 time: 0.247347 Oct 26 11:18:17.822866 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 8/15] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:17 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1267 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:17.822866 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-076354ea-695d-455a-981a-78ceb3314f59 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:17.822866 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-076354ea-695d-455a-981a-78ceb3314f59 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:17.902713 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-076354ea-695d-455a-981a-78ceb3314f59 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:17.905447 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-cf5f75a4-154e-4be1-a4c7-6e329d49ed41 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Flavor limits 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 11:18:17.905912 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-cf5f75a4-154e-4be1-a4c7-6e329d49ed41 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Image limits 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 11:18:17.906352 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-cf5f75a4-154e-4be1-a4c7-6e329d49ed41 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Flavor pref 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 11:18:17.906934 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-cf5f75a4-154e-4be1-a4c7-6e329d49ed41 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Image pref 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 11:18:17.907391 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-cf5f75a4-154e-4be1-a4c7-6e329d49ed41 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 11:18:17.912560 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-076354ea-695d-455a-981a-78ceb3314f59 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1221 microversion: 2.1 time: 0.094094 Oct 26 11:18:17.914414 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 9/16] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:17 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1221 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:17.919661 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-04affea4-9eb7-4776-a6cd-4144eef75e6d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1094204013", "imageRef": "ed8b5733-339c-4fa7-9767-abef514cb9f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b6fe9a7-2300-42a7-b12b-879816096b76"}], "security_groups": [{"name": "tempest-securitygroup--375477485"}], "key_name": "tempest-keypair-1171470675", "user_data": "}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:18:17.926300 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cf5f75a4-154e-4be1-a4c7-6e329d49ed41 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:17.927659 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cf5f75a4-154e-4be1-a4c7-6e329d49ed41 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:17.928221 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cf5f75a4-154e-4be1-a4c7-6e329d49ed41 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:17.929303 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cf5f75a4-154e-4be1-a4c7-6e329d49ed41 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:17.929984 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cf5f75a4-154e-4be1-a4c7-6e329d49ed41 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:17.932006 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cf5f75a4-154e-4be1-a4c7-6e329d49ed41 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:17.995058 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.quota [None req-cf5f75a4-154e-4be1-a4c7-6e329d49ed41 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Getting quotas for project ab29bf15969d46da9670efa2b52e6676. Resources: {'cores', 'instances', 'ram'} {{(pid=119305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:18:18.000301 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.quota [None req-cf5f75a4-154e-4be1-a4c7-6e329d49ed41 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Getting quotas for user 41276c93e476436791b89ab8a0d4537d and project ab29bf15969d46da9670efa2b52e6676. Resources: {'cores', 'instances', 'ram'} {{(pid=119305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:18:18.014618 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-cf5f75a4-154e-4be1-a4c7-6e329d49ed41 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Going to run 1 instances... {{(pid=119305) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 11:18:18.018109 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-cf5f75a4-154e-4be1-a4c7-6e329d49ed41 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed8b5733-339c-4fa7-9767-abef514cb9f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119305) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 11:18:18.075226 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.network.neutron [None req-04affea4-9eb7-4776-a6cd-4144eef75e6d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] validate_networks() for [('4b6fe9a7-2300-42a7-b12b-879816096b76', None, None, None, None, None)] {{(pid=119306) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 11:18:18.363167 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-cf5f75a4-154e-4be1-a4c7-6e329d49ed41 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.129665 Oct 26 11:18:18.364265 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 8/17] 10.222.0.42 () {62 vars in 1188 bytes} [Wed Oct 26 11:18:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 2132 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 11:18:18.371190 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-75c55c4b-0494-4c3d-a4fc-e9b84f564dc3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2053869827", "imageRef": "ed8b5733-339c-4fa7-9767-abef514cb9f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:18:18.445528 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.network.neutron [None req-75c55c4b-0494-4c3d-a4fc-e9b84f564dc3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] validate_networks() for [('0038bdd3-d1fb-456c-a8d4-41f13af7a1c5', None, None, None, None, None)] {{(pid=119305) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 11:18:18.837423 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-04affea4-9eb7-4776-a6cd-4144eef75e6d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Flavor limits 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 11:18:18.837941 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-04affea4-9eb7-4776-a6cd-4144eef75e6d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Image limits 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 11:18:18.838371 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-04affea4-9eb7-4776-a6cd-4144eef75e6d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Flavor pref 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 11:18:18.842644 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-04affea4-9eb7-4776-a6cd-4144eef75e6d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Image pref 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 11:18:18.842644 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-04affea4-9eb7-4776-a6cd-4144eef75e6d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 11:18:18.857588 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-04affea4-9eb7-4776-a6cd-4144eef75e6d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:18.860395 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-04affea4-9eb7-4776-a6cd-4144eef75e6d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:18.861064 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-04affea4-9eb7-4776-a6cd-4144eef75e6d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:18.866028 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-04affea4-9eb7-4776-a6cd-4144eef75e6d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:18.871363 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-04affea4-9eb7-4776-a6cd-4144eef75e6d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:18.871363 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-04affea4-9eb7-4776-a6cd-4144eef75e6d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:18.933487 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-04affea4-9eb7-4776-a6cd-4144eef75e6d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Getting quotas for project 724121c2144843b7adc7e17312613c9d. Resources: {'cores', 'instances', 'ram'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:18:18.957632 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-04affea4-9eb7-4776-a6cd-4144eef75e6d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Getting quotas for user e031dd9da25146eebb8813dc8bad8b85 and project 724121c2144843b7adc7e17312613c9d. Resources: {'cores', 'instances', 'ram'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:18:18.997276 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-04affea4-9eb7-4776-a6cd-4144eef75e6d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Going to run 1 instances... {{(pid=119306) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 11:18:18.999506 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-04affea4-9eb7-4776-a6cd-4144eef75e6d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed8b5733-339c-4fa7-9767-abef514cb9f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119306) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 11:18:19.282584 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-04affea4-9eb7-4776-a6cd-4144eef75e6d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.365611 Oct 26 11:18:19.287312 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 10/18] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Oct 26 11:18:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 1372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 11:18:19.298262 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-f421c625-d410-4cab-a8ba-c532ed94d52f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:19.299906 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-f421c625-d410-4cab-a8ba-c532ed94d52f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:19.451600 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-f421c625-d410-4cab-a8ba-c532ed94d52f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:19.465590 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-f421c625-d410-4cab-a8ba-c532ed94d52f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:19.469019 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-f421c625-d410-4cab-a8ba-c532ed94d52f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:19.470439 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-f421c625-d410-4cab-a8ba-c532ed94d52f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1281 microversion: 2.20 time: 0.181104 Oct 26 11:18:19.471020 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 11/19] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:18:19 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1281 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:18:19.517172 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-72406b17-bd01-41b0-9276-025e58ce3728 tempest-VolumesTestJSON-1519329759 tempest-VolumesTestJSON-1519329759-project] Calling method '.version_select at 0x7f6b93b8e430>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:19.633307 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-75c55c4b-0494-4c3d-a4fc-e9b84f564dc3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Flavor limits 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 11:18:19.633837 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-75c55c4b-0494-4c3d-a4fc-e9b84f564dc3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Image limits 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 11:18:19.638641 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-75c55c4b-0494-4c3d-a4fc-e9b84f564dc3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Flavor pref 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 11:18:19.638641 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-75c55c4b-0494-4c3d-a4fc-e9b84f564dc3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Image pref 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 11:18:19.638641 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-75c55c4b-0494-4c3d-a4fc-e9b84f564dc3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 11:18:19.686426 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-75c55c4b-0494-4c3d-a4fc-e9b84f564dc3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:19.687033 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-75c55c4b-0494-4c3d-a4fc-e9b84f564dc3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:19.687645 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-75c55c4b-0494-4c3d-a4fc-e9b84f564dc3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:19.688422 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-75c55c4b-0494-4c3d-a4fc-e9b84f564dc3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:19.688885 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-75c55c4b-0494-4c3d-a4fc-e9b84f564dc3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:19.693577 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-75c55c4b-0494-4c3d-a4fc-e9b84f564dc3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:19.773587 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-72406b17-bd01-41b0-9276-025e58ce3728 tempest-VolumesTestJSON-1519329759 tempest-VolumesTestJSON-1519329759-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/1532bb3b-d216-45d5-8289-c6cb67a06cae" status: 200 len: 351 microversion: 2.1 time: 0.279439 Oct 26 11:18:19.783459 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 12/20] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Oct 26 11:18:19 2022] GET /compute/v2.1/os-volumes/1532bb3b-d216-45d5-8289-c6cb67a06cae => generated 351 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:18:19.789678 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e4ce2efd-5ccc-473e-8a98-da193e8c381e tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:19.792008 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-e4ce2efd-5ccc-473e-8a98-da193e8c381e tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:19.802171 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.quota [None req-75c55c4b-0494-4c3d-a4fc-e9b84f564dc3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Getting quotas for project 9d9d2ce62fb74bdb8de53bc06b1a999d. Resources: {'cores', 'instances', 'ram'} {{(pid=119305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:18:19.826487 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e4ce2efd-5ccc-473e-8a98-da193e8c381e tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:19.827037 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e4ce2efd-5ccc-473e-8a98-da193e8c381e tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:19.827513 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e4ce2efd-5ccc-473e-8a98-da193e8c381e tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:19.828246 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e4ce2efd-5ccc-473e-8a98-da193e8c381e tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:19.834730 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.quota [None req-75c55c4b-0494-4c3d-a4fc-e9b84f564dc3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Getting quotas for user ff0c5f8521534fc1a0a9c5ea28fbaac1 and project 9d9d2ce62fb74bdb8de53bc06b1a999d. Resources: {'cores', 'instances', 'ram'} {{(pid=119305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:18:19.840961 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e4ce2efd-5ccc-473e-8a98-da193e8c381e tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:19.843260 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e4ce2efd-5ccc-473e-8a98-da193e8c381e tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:19.877028 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-75c55c4b-0494-4c3d-a4fc-e9b84f564dc3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Going to run 1 instances... {{(pid=119305) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 11:18:19.882444 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-75c55c4b-0494-4c3d-a4fc-e9b84f564dc3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed8b5733-339c-4fa7-9767-abef514cb9f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119305) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 11:18:20.062448 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-e4ce2efd-5ccc-473e-8a98-da193e8c381e tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:20.073794 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-e4ce2efd-5ccc-473e-8a98-da193e8c381e tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1273 microversion: 2.1 time: 0.286443 Oct 26 11:18:20.074429 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 13/21] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:19 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1273 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:20.084773 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-4b487abc-287c-49a6-80bb-3d2c8f8983a2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:20.085704 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-4b487abc-287c-49a6-80bb-3d2c8f8983a2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:20.195816 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-75c55c4b-0494-4c3d-a4fc-e9b84f564dc3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.828398 Oct 26 11:18:20.199534 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 9/22] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Oct 26 11:18:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 1834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 11:18:20.214171 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-f135259a-5e40-45fe-8e58-ad386c12a529 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:20.214842 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-f135259a-5e40-45fe-8e58-ad386c12a529 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:20.219932 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-4b487abc-287c-49a6-80bb-3d2c8f8983a2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:20.243328 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-4b487abc-287c-49a6-80bb-3d2c8f8983a2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1242 microversion: 2.1 time: 0.154629 Oct 26 11:18:20.243328 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 14/23] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:20 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1242 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:20.512777 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-7f2e297e-553d-4180-ac70-e1c00533b162 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:20.512777 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-7f2e297e-553d-4180-ac70-e1c00533b162 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:20.541114 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7f2e297e-553d-4180-ac70-e1c00533b162 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:20.542223 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7f2e297e-553d-4180-ac70-e1c00533b162 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:20.544087 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7f2e297e-553d-4180-ac70-e1c00533b162 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:20.545519 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7f2e297e-553d-4180-ac70-e1c00533b162 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:20.547535 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7f2e297e-553d-4180-ac70-e1c00533b162 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:20.549027 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7f2e297e-553d-4180-ac70-e1c00533b162 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:20.567466 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-f135259a-5e40-45fe-8e58-ad386c12a529 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:20.578464 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-f135259a-5e40-45fe-8e58-ad386c12a529 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1222 microversion: 2.1 time: 0.373348 Oct 26 11:18:20.582275 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 10/24] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:20 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1222 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:18:20.749789 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-7f2e297e-553d-4180-ac70-e1c00533b162 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:20.761345 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-7f2e297e-553d-4180-ac70-e1c00533b162 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:20.764699 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-7f2e297e-553d-4180-ac70-e1c00533b162 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:20.766688 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-7f2e297e-553d-4180-ac70-e1c00533b162 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1285 microversion: 2.20 time: 0.272706 Oct 26 11:18:20.767804 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 15/25] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:18:20 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1285 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:18:21.106567 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-ab2423e3-7d5c-4f72-8810-b86f9ca4cd54 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:21.113403 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-ab2423e3-7d5c-4f72-8810-b86f9ca4cd54 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:21.126039 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ab2423e3-7d5c-4f72-8810-b86f9ca4cd54 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:21.127621 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ab2423e3-7d5c-4f72-8810-b86f9ca4cd54 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:21.129559 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ab2423e3-7d5c-4f72-8810-b86f9ca4cd54 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:21.132480 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ab2423e3-7d5c-4f72-8810-b86f9ca4cd54 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:21.133066 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ab2423e3-7d5c-4f72-8810-b86f9ca4cd54 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:21.135010 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ab2423e3-7d5c-4f72-8810-b86f9ca4cd54 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:21.257006 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e6e8c85b-ef5f-4c5e-8b08-d569f6191ddd tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:21.261776 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-e6e8c85b-ef5f-4c5e-8b08-d569f6191ddd tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:21.409264 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-e6e8c85b-ef5f-4c5e-8b08-d569f6191ddd tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:21.417818 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-e6e8c85b-ef5f-4c5e-8b08-d569f6191ddd tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1242 microversion: 2.1 time: 0.165603 Oct 26 11:18:21.420273 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 16/26] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:21 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1242 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:21.606412 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-cecbc4b9-76c9-4019-884d-fe589ed3e6e2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:21.611335 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-cecbc4b9-76c9-4019-884d-fe589ed3e6e2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:21.811357 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-cecbc4b9-76c9-4019-884d-fe589ed3e6e2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:21.825163 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-cecbc4b9-76c9-4019-884d-fe589ed3e6e2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1222 microversion: 2.1 time: 0.222568 Oct 26 11:18:21.827580 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 17/27] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:21 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1222 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:18:21.837363 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-ae6d0cd8-1be0-455f-844b-d1a34f5b2ba5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:21.838393 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-ae6d0cd8-1be0-455f-844b-d1a34f5b2ba5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:21.866120 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ae6d0cd8-1be0-455f-844b-d1a34f5b2ba5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:21.866120 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ae6d0cd8-1be0-455f-844b-d1a34f5b2ba5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:21.866120 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ae6d0cd8-1be0-455f-844b-d1a34f5b2ba5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:21.866120 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ae6d0cd8-1be0-455f-844b-d1a34f5b2ba5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:21.866418 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ae6d0cd8-1be0-455f-844b-d1a34f5b2ba5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:21.866418 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ae6d0cd8-1be0-455f-844b-d1a34f5b2ba5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:21.937033 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-ab2423e3-7d5c-4f72-8810-b86f9ca4cd54 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:21.974273 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-ab2423e3-7d5c-4f72-8810-b86f9ca4cd54 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1315 microversion: 2.1 time: 0.873646 Oct 26 11:18:21.976711 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 11/28] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:21 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1315 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:22.070845 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ae6d0cd8-1be0-455f-844b-d1a34f5b2ba5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:22.101251 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ae6d0cd8-1be0-455f-844b-d1a34f5b2ba5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:22.101251 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ae6d0cd8-1be0-455f-844b-d1a34f5b2ba5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:22.101251 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-ae6d0cd8-1be0-455f-844b-d1a34f5b2ba5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1333 microversion: 2.20 time: 0.255321 Oct 26 11:18:22.102042 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 18/29] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:18:21 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1333 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:18:22.451541 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a8e35774-f95e-4caf-afbb-45341d23a759 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:22.453761 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-a8e35774-f95e-4caf-afbb-45341d23a759 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:22.461869 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a8e35774-f95e-4caf-afbb-45341d23a759 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:22.466219 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a8e35774-f95e-4caf-afbb-45341d23a759 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:22.466219 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a8e35774-f95e-4caf-afbb-45341d23a759 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:22.466219 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a8e35774-f95e-4caf-afbb-45341d23a759 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:22.466219 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a8e35774-f95e-4caf-afbb-45341d23a759 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:22.466577 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a8e35774-f95e-4caf-afbb-45341d23a759 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:22.628019 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-a8e35774-f95e-4caf-afbb-45341d23a759 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:22.653719 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-a8e35774-f95e-4caf-afbb-45341d23a759 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1238 microversion: 2.1 time: 0.189634 Oct 26 11:18:22.653719 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 12/30] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:22 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1238 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:22.850588 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-838f0ca1-27cc-44b1-98fa-2a71fec89ccd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:22.852713 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-838f0ca1-27cc-44b1-98fa-2a71fec89ccd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:22.862214 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-838f0ca1-27cc-44b1-98fa-2a71fec89ccd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:22.864791 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-838f0ca1-27cc-44b1-98fa-2a71fec89ccd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:22.869748 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-838f0ca1-27cc-44b1-98fa-2a71fec89ccd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:22.892446 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-838f0ca1-27cc-44b1-98fa-2a71fec89ccd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:22.892446 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-838f0ca1-27cc-44b1-98fa-2a71fec89ccd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:22.892446 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-838f0ca1-27cc-44b1-98fa-2a71fec89ccd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:22.980096 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-838f0ca1-27cc-44b1-98fa-2a71fec89ccd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:22.991150 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-838f0ca1-27cc-44b1-98fa-2a71fec89ccd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1226 microversion: 2.1 time: 0.144647 Oct 26 11:18:22.992773 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 19/31] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:22 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1226 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:23.008066 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-4e0bb4e4-6c6b-488e-9647-1b2d18b29efe tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:23.009029 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-4e0bb4e4-6c6b-488e-9647-1b2d18b29efe tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:23.021484 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4e0bb4e4-6c6b-488e-9647-1b2d18b29efe tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:23.021989 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4e0bb4e4-6c6b-488e-9647-1b2d18b29efe tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:23.022438 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4e0bb4e4-6c6b-488e-9647-1b2d18b29efe tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:23.023189 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4e0bb4e4-6c6b-488e-9647-1b2d18b29efe tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:23.023651 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4e0bb4e4-6c6b-488e-9647-1b2d18b29efe tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:23.028242 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4e0bb4e4-6c6b-488e-9647-1b2d18b29efe tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:23.130685 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-ff72e46a-a825-4ff8-b4eb-6dd2d81126f8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:23.131360 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-ff72e46a-a825-4ff8-b4eb-6dd2d81126f8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:23.145499 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ff72e46a-a825-4ff8-b4eb-6dd2d81126f8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:23.146611 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ff72e46a-a825-4ff8-b4eb-6dd2d81126f8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:23.147596 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ff72e46a-a825-4ff8-b4eb-6dd2d81126f8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:23.150551 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ff72e46a-a825-4ff8-b4eb-6dd2d81126f8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:23.151098 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ff72e46a-a825-4ff8-b4eb-6dd2d81126f8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:23.152544 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ff72e46a-a825-4ff8-b4eb-6dd2d81126f8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:23.374974 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ff72e46a-a825-4ff8-b4eb-6dd2d81126f8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:23.386490 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ff72e46a-a825-4ff8-b4eb-6dd2d81126f8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:23.392139 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ff72e46a-a825-4ff8-b4eb-6dd2d81126f8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:23.395856 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-ff72e46a-a825-4ff8-b4eb-6dd2d81126f8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1333 microversion: 2.20 time: 0.269596 Oct 26 11:18:23.398492 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 20/32] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:18:23 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1333 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:18:23.412492 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-4e0bb4e4-6c6b-488e-9647-1b2d18b29efe tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:23.424479 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-4e0bb4e4-6c6b-488e-9647-1b2d18b29efe tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1315 microversion: 2.1 time: 0.429306 Oct 26 11:18:23.439212 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 13/33] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:22 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:23.650972 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-14555273-e340-4571-a901-2402a0131d9f tempest-VolumesTestJSON-1519329759 tempest-VolumesTestJSON-1519329759-project] Calling method '.version_select at 0x7f6b93b394c0>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:23.662511 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-4599713f-fa2f-45b3-b662-aa4cf02f6a2e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:23.663164 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-4599713f-fa2f-45b3-b662-aa4cf02f6a2e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:23.686258 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4599713f-fa2f-45b3-b662-aa4cf02f6a2e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:23.686798 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4599713f-fa2f-45b3-b662-aa4cf02f6a2e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:23.687265 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4599713f-fa2f-45b3-b662-aa4cf02f6a2e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:23.687992 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4599713f-fa2f-45b3-b662-aa4cf02f6a2e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:23.688410 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4599713f-fa2f-45b3-b662-aa4cf02f6a2e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:23.688834 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4599713f-fa2f-45b3-b662-aa4cf02f6a2e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:23.853465 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-14555273-e340-4571-a901-2402a0131d9f tempest-VolumesTestJSON-1519329759 tempest-VolumesTestJSON-1519329759-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/1e88b588-ecf6-4728-8386-a7e97954db70" status: 200 len: 351 microversion: 2.1 time: 0.207145 Oct 26 11:18:23.854414 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 21/34] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Oct 26 11:18:23 2022] GET /compute/v2.1/os-volumes/1e88b588-ecf6-4728-8386-a7e97954db70 => generated 351 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:18:23.889658 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-4599713f-fa2f-45b3-b662-aa4cf02f6a2e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:23.912083 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-4599713f-fa2f-45b3-b662-aa4cf02f6a2e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1238 microversion: 2.1 time: 0.254535 Oct 26 11:18:23.925280 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 14/35] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:23 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1238 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:24.017203 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-b5ea614e-8461-41be-be7d-9e51f2394184 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:24.018176 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-b5ea614e-8461-41be-be7d-9e51f2394184 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:24.044774 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b5ea614e-8461-41be-be7d-9e51f2394184 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:24.045279 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b5ea614e-8461-41be-be7d-9e51f2394184 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:24.045717 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b5ea614e-8461-41be-be7d-9e51f2394184 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:24.046422 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b5ea614e-8461-41be-be7d-9e51f2394184 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:24.061118 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b5ea614e-8461-41be-be7d-9e51f2394184 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:24.061118 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b5ea614e-8461-41be-be7d-9e51f2394184 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:24.380851 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-b5ea614e-8461-41be-be7d-9e51f2394184 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:24.396628 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-b5ea614e-8461-41be-be7d-9e51f2394184 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1218 microversion: 2.1 time: 0.382123 Oct 26 11:18:24.423641 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 22/36] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:24 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1218 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:24.425399 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-b6dcbdce-cf99-4fb3-9b9e-c39a1edbb5e9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:24.426261 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-b6dcbdce-cf99-4fb3-9b9e-c39a1edbb5e9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:24.434331 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b6dcbdce-cf99-4fb3-9b9e-c39a1edbb5e9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:24.435146 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b6dcbdce-cf99-4fb3-9b9e-c39a1edbb5e9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:24.435754 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b6dcbdce-cf99-4fb3-9b9e-c39a1edbb5e9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:24.436892 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b6dcbdce-cf99-4fb3-9b9e-c39a1edbb5e9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:24.437749 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b6dcbdce-cf99-4fb3-9b9e-c39a1edbb5e9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:24.438558 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b6dcbdce-cf99-4fb3-9b9e-c39a1edbb5e9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:24.455854 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-08727802-2ebc-4cc1-b2ed-07a3cabecafc tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:24.456944 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-08727802-2ebc-4cc1-b2ed-07a3cabecafc tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:24.482955 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-08727802-2ebc-4cc1-b2ed-07a3cabecafc tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:24.483545 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-08727802-2ebc-4cc1-b2ed-07a3cabecafc tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:24.484050 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-08727802-2ebc-4cc1-b2ed-07a3cabecafc tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:24.484879 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-08727802-2ebc-4cc1-b2ed-07a3cabecafc tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:24.485460 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-08727802-2ebc-4cc1-b2ed-07a3cabecafc tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:24.485959 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-08727802-2ebc-4cc1-b2ed-07a3cabecafc tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:24.624579 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-b6dcbdce-cf99-4fb3-9b9e-c39a1edbb5e9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:24.651125 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-b6dcbdce-cf99-4fb3-9b9e-c39a1edbb5e9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:24.653119 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-b6dcbdce-cf99-4fb3-9b9e-c39a1edbb5e9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:24.656453 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-b6dcbdce-cf99-4fb3-9b9e-c39a1edbb5e9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1339 microversion: 2.20 time: 0.235116 Oct 26 11:18:24.661907 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 15/37] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:18:24 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1339 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 11:18:24.948494 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-ed97d21c-8b5e-42b9-bbe4-02c1d5749e6c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:24.951453 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-ed97d21c-8b5e-42b9-bbe4-02c1d5749e6c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:24.982177 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ed97d21c-8b5e-42b9-bbe4-02c1d5749e6c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:24.983285 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ed97d21c-8b5e-42b9-bbe4-02c1d5749e6c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:24.984043 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ed97d21c-8b5e-42b9-bbe4-02c1d5749e6c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:24.985357 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ed97d21c-8b5e-42b9-bbe4-02c1d5749e6c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:24.986509 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ed97d21c-8b5e-42b9-bbe4-02c1d5749e6c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:24.988407 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ed97d21c-8b5e-42b9-bbe4-02c1d5749e6c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:25.197521 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-ed97d21c-8b5e-42b9-bbe4-02c1d5749e6c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:25.217747 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-ed97d21c-8b5e-42b9-bbe4-02c1d5749e6c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1238 microversion: 2.1 time: 0.275399 Oct 26 11:18:25.228128 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 16/38] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:24 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1238 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:18:25.367683 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-08727802-2ebc-4cc1-b2ed-07a3cabecafc tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:25.377508 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-08727802-2ebc-4cc1-b2ed-07a3cabecafc tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1315 microversion: 2.1 time: 0.927536 Oct 26 11:18:25.382440 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 23/39] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:24 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1315 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:25.424266 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-4f18127e-cfb7-439e-b67b-3d240dd3d626 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:25.425151 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-4f18127e-cfb7-439e-b67b-3d240dd3d626 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:25.437252 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4f18127e-cfb7-439e-b67b-3d240dd3d626 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:25.437976 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4f18127e-cfb7-439e-b67b-3d240dd3d626 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:25.443156 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4f18127e-cfb7-439e-b67b-3d240dd3d626 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:25.447620 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4f18127e-cfb7-439e-b67b-3d240dd3d626 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:25.448352 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4f18127e-cfb7-439e-b67b-3d240dd3d626 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:25.449152 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4f18127e-cfb7-439e-b67b-3d240dd3d626 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:25.688892 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-1b4ca51a-dc24-4391-90d6-a0ff8cc2b901 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:25.689404 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-1b4ca51a-dc24-4391-90d6-a0ff8cc2b901 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:25.708111 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1b4ca51a-dc24-4391-90d6-a0ff8cc2b901 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:25.709272 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1b4ca51a-dc24-4391-90d6-a0ff8cc2b901 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:25.715026 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1b4ca51a-dc24-4391-90d6-a0ff8cc2b901 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:25.719817 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1b4ca51a-dc24-4391-90d6-a0ff8cc2b901 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:25.730158 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1b4ca51a-dc24-4391-90d6-a0ff8cc2b901 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:25.730799 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1b4ca51a-dc24-4391-90d6-a0ff8cc2b901 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:25.838128 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-4f18127e-cfb7-439e-b67b-3d240dd3d626 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:25.852659 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-4f18127e-cfb7-439e-b67b-3d240dd3d626 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1218 microversion: 2.1 time: 0.432569 Oct 26 11:18:25.854048 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 17/40] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:25 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1218 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:26.022935 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-1b4ca51a-dc24-4391-90d6-a0ff8cc2b901 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:26.040389 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-1b4ca51a-dc24-4391-90d6-a0ff8cc2b901 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:26.047957 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-1b4ca51a-dc24-4391-90d6-a0ff8cc2b901 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:26.049899 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-1b4ca51a-dc24-4391-90d6-a0ff8cc2b901 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1339 microversion: 2.20 time: 0.365272 Oct 26 11:18:26.063491 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 24/41] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:18:25 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1339 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:18:26.245674 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-3ebebcc5-e4ef-453f-b943-05b9c6d475ee tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:26.246294 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-3ebebcc5-e4ef-453f-b943-05b9c6d475ee tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:26.261427 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3ebebcc5-e4ef-453f-b943-05b9c6d475ee tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:26.262075 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3ebebcc5-e4ef-453f-b943-05b9c6d475ee tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:26.262535 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3ebebcc5-e4ef-453f-b943-05b9c6d475ee tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:26.264858 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3ebebcc5-e4ef-453f-b943-05b9c6d475ee tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:26.265337 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3ebebcc5-e4ef-453f-b943-05b9c6d475ee tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:26.269780 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3ebebcc5-e4ef-453f-b943-05b9c6d475ee tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:26.417151 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-95a8df03-a5bb-4c5a-97c3-acab6c271a3d tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:26.419050 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-95a8df03-a5bb-4c5a-97c3-acab6c271a3d tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:26.463340 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-95a8df03-a5bb-4c5a-97c3-acab6c271a3d tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:26.463909 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-95a8df03-a5bb-4c5a-97c3-acab6c271a3d tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:26.469071 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-95a8df03-a5bb-4c5a-97c3-acab6c271a3d tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:26.477454 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-95a8df03-a5bb-4c5a-97c3-acab6c271a3d tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:26.477454 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-95a8df03-a5bb-4c5a-97c3-acab6c271a3d tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:26.477454 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-95a8df03-a5bb-4c5a-97c3-acab6c271a3d tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:26.736112 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-3ebebcc5-e4ef-453f-b943-05b9c6d475ee tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:26.755765 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-3ebebcc5-e4ef-453f-b943-05b9c6d475ee tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1294 microversion: 2.1 time: 0.512882 Oct 26 11:18:26.772096 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 18/42] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:26 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1294 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:26.877816 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-4c8b76b0-9921-4abf-8463-35ade8107851 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:26.878696 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-4c8b76b0-9921-4abf-8463-35ade8107851 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:26.886117 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4c8b76b0-9921-4abf-8463-35ade8107851 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:26.886622 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4c8b76b0-9921-4abf-8463-35ade8107851 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:26.887195 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4c8b76b0-9921-4abf-8463-35ade8107851 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:26.888037 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4c8b76b0-9921-4abf-8463-35ade8107851 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:26.888510 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4c8b76b0-9921-4abf-8463-35ade8107851 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:26.888950 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4c8b76b0-9921-4abf-8463-35ade8107851 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:27.029944 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-95a8df03-a5bb-4c5a-97c3-acab6c271a3d tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:27.047872 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-4c8b76b0-9921-4abf-8463-35ade8107851 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:27.054005 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-95a8df03-a5bb-4c5a-97c3-acab6c271a3d tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1315 microversion: 2.1 time: 0.652189 Oct 26 11:18:27.056708 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 25/43] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:26 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1315 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:27.072205 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-4c8b76b0-9921-4abf-8463-35ade8107851 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1218 microversion: 2.1 time: 0.199244 Oct 26 11:18:27.084459 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 19/44] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:26 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1218 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:18:27.095038 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-d9e8b3bd-12c3-4730-834f-45fb4e00d95b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:27.095659 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-d9e8b3bd-12c3-4730-834f-45fb4e00d95b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:27.111088 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d9e8b3bd-12c3-4730-834f-45fb4e00d95b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:27.111088 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d9e8b3bd-12c3-4730-834f-45fb4e00d95b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:27.111088 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d9e8b3bd-12c3-4730-834f-45fb4e00d95b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:27.111088 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d9e8b3bd-12c3-4730-834f-45fb4e00d95b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:27.111384 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d9e8b3bd-12c3-4730-834f-45fb4e00d95b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:27.111384 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d9e8b3bd-12c3-4730-834f-45fb4e00d95b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:27.128869 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-7f4a8f36-44d4-4859-8f95-7efca47bb1b2 tempest-VolumesTestJSON-1519329759 tempest-VolumesTestJSON-1519329759-project] Calling method '.version_select at 0x7f6b94430ee0>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:27.217969 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-7f4a8f36-44d4-4859-8f95-7efca47bb1b2 tempest-VolumesTestJSON-1519329759 tempest-VolumesTestJSON-1519329759-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/eebc5d44-5ac4-4182-9b9c-681e16d3f0db" status: 200 len: 350 microversion: 2.1 time: 0.093149 Oct 26 11:18:27.218868 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 20/45] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Oct 26 11:18:27 2022] GET /compute/v2.1/os-volumes/eebc5d44-5ac4-4182-9b9c-681e16d3f0db => generated 350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:18:27.233047 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-d8b93bee-e999-48f9-aa92-5717bf0248d1 tempest-VolumesTestJSON-1519329759 tempest-VolumesTestJSON-1519329759-project] Calling method '.version_select at 0x7f6b93b669d0>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:27.387581 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-d8b93bee-e999-48f9-aa92-5717bf0248d1 tempest-VolumesTestJSON-1519329759 tempest-VolumesTestJSON-1519329759-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.158316 Oct 26 11:18:27.392941 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 21/46] 10.222.0.42 () {58 vars in 1134 bytes} [Wed Oct 26 11:18:27 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:18:27.404374 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-070154bc-a21e-4548-9a08-31705ebb47db tempest-VolumesTestJSON-1519329759 tempest-VolumesTestJSON-1519329759-project] Calling method '.version_select at 0x7f6b93c1ce50>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:27.545458 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-070154bc-a21e-4548-9a08-31705ebb47db tempest-VolumesTestJSON-1519329759 tempest-VolumesTestJSON-1519329759-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.144789 Oct 26 11:18:27.557228 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 22/47] 10.222.0.42 () {58 vars in 1149 bytes} [Wed Oct 26 11:18:27 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:18:27.563499 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-6b8154c2-c406-447e-8da2-5e994fe2dc1e tempest-VolumesTestJSON-1519329759 tempest-VolumesTestJSON-1519329759-project] Calling method '.version_select at 0x7f6b94430550>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:27.712842 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-6b8154c2-c406-447e-8da2-5e994fe2dc1e tempest-VolumesTestJSON-1519329759 tempest-VolumesTestJSON-1519329759-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.153861 Oct 26 11:18:27.723267 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 23/48] 10.222.0.42 () {58 vars in 1134 bytes} [Wed Oct 26 11:18:27 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:27.729003 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-3b7abc06-83e3-4f6f-b294-b23b3e46f80b tempest-VolumesTestJSON-1519329759 tempest-VolumesTestJSON-1519329759-project] Calling method '.version_select at 0x7f6b93b77ca0>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:27.927462 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-3b7abc06-83e3-4f6f-b294-b23b3e46f80b tempest-VolumesTestJSON-1519329759 tempest-VolumesTestJSON-1519329759-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.202079 Oct 26 11:18:27.946750 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 24/49] 10.222.0.42 () {58 vars in 1167 bytes} [Wed Oct 26 11:18:27 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:18:27.952904 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-d9e8b3bd-12c3-4730-834f-45fb4e00d95b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:27.954119 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-20268063-ee01-4eb5-ad77-1459349b9bba tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:27.955009 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-20268063-ee01-4eb5-ad77-1459349b9bba tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:27.964344 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-20268063-ee01-4eb5-ad77-1459349b9bba tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:27.966979 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-20268063-ee01-4eb5-ad77-1459349b9bba tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:27.966979 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-20268063-ee01-4eb5-ad77-1459349b9bba tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:27.967155 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-d9e8b3bd-12c3-4730-834f-45fb4e00d95b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:27.967244 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-20268063-ee01-4eb5-ad77-1459349b9bba tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:27.967608 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-20268063-ee01-4eb5-ad77-1459349b9bba tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:27.968538 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-20268063-ee01-4eb5-ad77-1459349b9bba tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:27.969546 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-d9e8b3bd-12c3-4730-834f-45fb4e00d95b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:27.971834 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-d9e8b3bd-12c3-4730-834f-45fb4e00d95b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1406 microversion: 2.20 time: 0.880889 Oct 26 11:18:27.972747 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:18:27 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1406 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:18:27.979339 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-ecc4b98c-0853-4cc5-968f-ade1c3830788 tempest-VolumesTestJSON-1519329759 tempest-VolumesTestJSON-1519329759-project] Calling method '.version_select at 0x7f6b93b8e430>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:28.129314 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-ecc4b98c-0853-4cc5-968f-ade1c3830788 tempest-VolumesTestJSON-1519329759 tempest-VolumesTestJSON-1519329759-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.155264 Oct 26 11:18:28.130960 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 27/51] 10.222.0.42 () {58 vars in 1170 bytes} [Wed Oct 26 11:18:27 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:18:28.136868 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-db87ecb2-f454-453a-91bd-9bdf45b15dc3 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:28.140452 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-db87ecb2-f454-453a-91bd-9bdf45b15dc3 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:28.147735 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-db87ecb2-f454-453a-91bd-9bdf45b15dc3 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:28.148454 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-db87ecb2-f454-453a-91bd-9bdf45b15dc3 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:28.149201 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-db87ecb2-f454-453a-91bd-9bdf45b15dc3 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:28.150073 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-db87ecb2-f454-453a-91bd-9bdf45b15dc3 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:28.150729 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-db87ecb2-f454-453a-91bd-9bdf45b15dc3 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:28.151393 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-db87ecb2-f454-453a-91bd-9bdf45b15dc3 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:28.409205 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-20268063-ee01-4eb5-ad77-1459349b9bba tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:28.417951 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-20268063-ee01-4eb5-ad77-1459349b9bba tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1312 microversion: 2.1 time: 0.469664 Oct 26 11:18:28.422464 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 25/52] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:27 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1312 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:28.443755 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-f83c05cc-7e30-419f-9481-92e0d2ecbec3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:28.444654 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-f83c05cc-7e30-419f-9481-92e0d2ecbec3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:28.455307 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f83c05cc-7e30-419f-9481-92e0d2ecbec3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:28.456164 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f83c05cc-7e30-419f-9481-92e0d2ecbec3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:28.456858 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f83c05cc-7e30-419f-9481-92e0d2ecbec3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:28.457763 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f83c05cc-7e30-419f-9481-92e0d2ecbec3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:28.458438 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f83c05cc-7e30-419f-9481-92e0d2ecbec3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:28.462704 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f83c05cc-7e30-419f-9481-92e0d2ecbec3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:28.610567 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-db87ecb2-f454-453a-91bd-9bdf45b15dc3 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:28.623464 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-db87ecb2-f454-453a-91bd-9bdf45b15dc3 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1315 microversion: 2.1 time: 0.490882 Oct 26 11:18:28.625293 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 28/53] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:28 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1315 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:28.646303 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-6624c9df-af9d-4ebb-8723-29faa063a1a1 tempest-VolumesTestJSON-1519329759 tempest-VolumesTestJSON-1519329759-project] Calling method '.version_select at 0x7f6b93b7d670>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:28.720268 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-f83c05cc-7e30-419f-9481-92e0d2ecbec3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:28.734534 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-f83c05cc-7e30-419f-9481-92e0d2ecbec3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1274 microversion: 2.1 time: 0.310609 Oct 26 11:18:28.744414 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 26/54] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:28 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1274 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:28.797565 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-6624c9df-af9d-4ebb-8723-29faa063a1a1 tempest-VolumesTestJSON-1519329759 tempest-VolumesTestJSON-1519329759-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.171018 Oct 26 11:18:28.802811 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 29/55] 10.222.0.42 () {58 vars in 1155 bytes} [Wed Oct 26 11:18:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:28.822796 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-a8439615-ec6b-44d0-82e4-f67ac23af26d tempest-VolumesTestJSON-1519329759 tempest-VolumesTestJSON-1519329759-project] Calling method '.version_select at 0x7f6b93b8e280>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:28.888101 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell0:SELECT=6 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:29.067117 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-6571156e-e371-474e-be7e-808e19529ee8 req-1d0bf8cc-1cc3-443d-802b-1f67943a94ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3db7d6af-35ae-45dd-922d-ee3f0251f4be", "tag": "20595fc6-a44c-4ee8-ae66-ce10051ef26d"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:18:29.073186 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-a8439615-ec6b-44d0-82e4-f67ac23af26d tempest-VolumesTestJSON-1519329759 tempest-VolumesTestJSON-1519329759-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.259435 Oct 26 11:18:29.075373 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 30/56] 10.222.0.42 () {58 vars in 1188 bytes} [Wed Oct 26 11:18:28 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:18:29.087209 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-3b39e112-29c1-429f-9b82-dc5cedee0396 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:29.088593 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-3b39e112-29c1-429f-9b82-dc5cedee0396 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:29.095482 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:29.098576 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3b39e112-29c1-429f-9b82-dc5cedee0396 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:29.099372 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3b39e112-29c1-429f-9b82-dc5cedee0396 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:29.100022 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3b39e112-29c1-429f-9b82-dc5cedee0396 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:29.101202 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3b39e112-29c1-429f-9b82-dc5cedee0396 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:29.102997 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3b39e112-29c1-429f-9b82-dc5cedee0396 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:29.103808 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3b39e112-29c1-429f-9b82-dc5cedee0396 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:29.124254 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-6571156e-e371-474e-be7e-808e19529ee8 req-1d0bf8cc-1cc3-443d-802b-1f67943a94ac service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:29.124828 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-6571156e-e371-474e-be7e-808e19529ee8 req-1d0bf8cc-1cc3-443d-802b-1f67943a94ac service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:29.127902 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-6571156e-e371-474e-be7e-808e19529ee8 req-1d0bf8cc-1cc3-443d-802b-1f67943a94ac service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:29.202495 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-6571156e-e371-474e-be7e-808e19529ee8 req-1d0bf8cc-1cc3-443d-802b-1f67943a94ac service nova] Creating event network-changed:20595fc6-a44c-4ee8-ae66-ce10051ef26d for instance 3db7d6af-35ae-45dd-922d-ee3f0251f4be on hv-cinder-81558 Oct 26 11:18:29.204422 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-6571156e-e371-474e-be7e-808e19529ee8 req-1d0bf8cc-1cc3-443d-802b-1f67943a94ac service nova] Acquiring lock "compute-rpcapi-router" {{(pid=119305) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 26 11:18:29.206482 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-6571156e-e371-474e-be7e-808e19529ee8 req-1d0bf8cc-1cc3-443d-802b-1f67943a94ac service nova] Acquired lock "compute-rpcapi-router" {{(pid=119305) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 26 11:18:29.207632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fbe4ff73-72e8-492c-a357-9e66a005577f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:29.208100 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fbe4ff73-72e8-492c-a357-9e66a005577f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:29.208566 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fbe4ff73-72e8-492c-a357-9e66a005577f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:29.209285 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fbe4ff73-72e8-492c-a357-9e66a005577f None None] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:29.222434 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fbe4ff73-72e8-492c-a357-9e66a005577f None None] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:29.225134 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fbe4ff73-72e8-492c-a357-9e66a005577f None None] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:29.252428 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.compute.rpcapi [None req-fbe4ff73-72e8-492c-a357-9e66a005577f None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 26 11:18:29.259521 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fbe4ff73-72e8-492c-a357-9e66a005577f None None] Releasing lock "compute-rpcapi-router" {{(pid=119305) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 26 11:18:29.316609 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-fbe4ff73-72e8-492c-a357-9e66a005577f None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.562641 Oct 26 11:18:29.325939 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 27/57] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:18:29.339488 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-4d08a4c8-e9ce-431e-9460-c63ab0413625 tempest-VolumesTestJSON-1519329759 tempest-VolumesTestJSON-1519329759-project] Calling method '.version_select at 0x7f6b93b66160>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:29.464410 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-4d08a4c8-e9ce-431e-9460-c63ab0413625 tempest-VolumesTestJSON-1519329759 tempest-VolumesTestJSON-1519329759-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.138914 Oct 26 11:18:29.468778 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 28/58] 10.222.0.42 () {58 vars in 1155 bytes} [Wed Oct 26 11:18:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:29.471003 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-24abb7a1-9d7c-43c6-a533-99496d7d52c5 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:29.471959 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-24abb7a1-9d7c-43c6-a533-99496d7d52c5 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:29.483022 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-24abb7a1-9d7c-43c6-a533-99496d7d52c5 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:29.483721 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-24abb7a1-9d7c-43c6-a533-99496d7d52c5 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:29.484570 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-24abb7a1-9d7c-43c6-a533-99496d7d52c5 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:29.485513 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-24abb7a1-9d7c-43c6-a533-99496d7d52c5 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:29.487167 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-24abb7a1-9d7c-43c6-a533-99496d7d52c5 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:29.488501 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-24abb7a1-9d7c-43c6-a533-99496d7d52c5 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:29.727571 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-24abb7a1-9d7c-43c6-a533-99496d7d52c5 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:29.736624 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-24abb7a1-9d7c-43c6-a533-99496d7d52c5 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1300 microversion: 2.1 time: 0.269591 Oct 26 11:18:29.738664 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 29/59] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:29 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1300 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:29.761671 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-27aeaf1c-f1da-4c4b-86da-04fe65e9b3a9 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:29.766417 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-27aeaf1c-f1da-4c4b-86da-04fe65e9b3a9 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:29.796512 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-27aeaf1c-f1da-4c4b-86da-04fe65e9b3a9 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:29.812693 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-27aeaf1c-f1da-4c4b-86da-04fe65e9b3a9 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:29.813472 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-27aeaf1c-f1da-4c4b-86da-04fe65e9b3a9 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:29.814297 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-27aeaf1c-f1da-4c4b-86da-04fe65e9b3a9 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:29.814720 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-27aeaf1c-f1da-4c4b-86da-04fe65e9b3a9 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:29.815178 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-27aeaf1c-f1da-4c4b-86da-04fe65e9b3a9 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:30.099496 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-3b39e112-29c1-429f-9b82-dc5cedee0396 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:30.110728 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-3b39e112-29c1-429f-9b82-dc5cedee0396 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:30.116507 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-3b39e112-29c1-429f-9b82-dc5cedee0396 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:30.117977 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-3b39e112-29c1-429f-9b82-dc5cedee0396 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1406 microversion: 2.20 time: 1.040849 Oct 26 11:18:30.134123 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 31/60] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:18:29 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1406 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:18:30.149413 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-3cef5e9d-5080-44a2-9a41-324b475e53ed tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:30.152757 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-3cef5e9d-5080-44a2-9a41-324b475e53ed tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:30.164985 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3cef5e9d-5080-44a2-9a41-324b475e53ed tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:30.165473 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3cef5e9d-5080-44a2-9a41-324b475e53ed tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:30.165898 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3cef5e9d-5080-44a2-9a41-324b475e53ed tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:30.173800 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3cef5e9d-5080-44a2-9a41-324b475e53ed tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:30.173800 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3cef5e9d-5080-44a2-9a41-324b475e53ed tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:30.173800 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3cef5e9d-5080-44a2-9a41-324b475e53ed tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:30.217618 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-27aeaf1c-f1da-4c4b-86da-04fe65e9b3a9 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:30.227127 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-27aeaf1c-f1da-4c4b-86da-04fe65e9b3a9 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1315 microversion: 2.1 time: 0.482687 Oct 26 11:18:30.229910 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 30/61] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:29 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:30.432168 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-3cef5e9d-5080-44a2-9a41-324b475e53ed tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:30.452724 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-3cef5e9d-5080-44a2-9a41-324b475e53ed tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1280 microversion: 2.1 time: 0.310544 Oct 26 11:18:30.457017 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 32/62] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:30 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1280 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:30.788217 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-41757d33-3980-4fb5-a776-501be26adc1b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:30.791314 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-41757d33-3980-4fb5-a776-501be26adc1b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:30.808777 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell0:SELECT=24 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:30.843000 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-41757d33-3980-4fb5-a776-501be26adc1b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:30.845900 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-41757d33-3980-4fb5-a776-501be26adc1b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:30.846367 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-41757d33-3980-4fb5-a776-501be26adc1b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:30.848954 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-41757d33-3980-4fb5-a776-501be26adc1b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:30.852980 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-41757d33-3980-4fb5-a776-501be26adc1b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:30.854724 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-41757d33-3980-4fb5-a776-501be26adc1b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:31.149918 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-1c08f3a9-28ef-4077-be78-bb50ea4da0a0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:31.150586 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-1c08f3a9-28ef-4077-be78-bb50ea4da0a0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:31.160154 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1c08f3a9-28ef-4077-be78-bb50ea4da0a0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:31.160656 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1c08f3a9-28ef-4077-be78-bb50ea4da0a0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:31.161089 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1c08f3a9-28ef-4077-be78-bb50ea4da0a0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:31.161831 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1c08f3a9-28ef-4077-be78-bb50ea4da0a0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:31.167763 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1c08f3a9-28ef-4077-be78-bb50ea4da0a0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:31.168496 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1c08f3a9-28ef-4077-be78-bb50ea4da0a0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:31.340913 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-41757d33-3980-4fb5-a776-501be26adc1b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:31.349428 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-41757d33-3980-4fb5-a776-501be26adc1b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1300 microversion: 2.1 time: 0.580184 Oct 26 11:18:31.359804 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 31/63] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:30 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1300 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:18:31.379157 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-3e598f23-1e2e-46ee-8e20-c57a2e7bd4b9 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:31.380259 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-3e598f23-1e2e-46ee-8e20-c57a2e7bd4b9 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:31.404179 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3e598f23-1e2e-46ee-8e20-c57a2e7bd4b9 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:31.405095 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3e598f23-1e2e-46ee-8e20-c57a2e7bd4b9 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:31.406741 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3e598f23-1e2e-46ee-8e20-c57a2e7bd4b9 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:31.407800 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3e598f23-1e2e-46ee-8e20-c57a2e7bd4b9 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:31.410779 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3e598f23-1e2e-46ee-8e20-c57a2e7bd4b9 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:31.414567 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3e598f23-1e2e-46ee-8e20-c57a2e7bd4b9 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:31.803252 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-1c08f3a9-28ef-4077-be78-bb50ea4da0a0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:31.848378 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell0:SELECT=30 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:31.852769 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-1c08f3a9-28ef-4077-be78-bb50ea4da0a0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:31.855130 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-1c08f3a9-28ef-4077-be78-bb50ea4da0a0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:31.856176 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-1c08f3a9-28ef-4077-be78-bb50ea4da0a0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1406 microversion: 2.20 time: 0.710714 Oct 26 11:18:31.863368 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:18:31 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1406 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:18:31.887601 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-83085e0e-910b-4887-a05a-99215df99887 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:31.899178 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-83085e0e-910b-4887-a05a-99215df99887 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:31.907944 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-83085e0e-910b-4887-a05a-99215df99887 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:31.909037 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-83085e0e-910b-4887-a05a-99215df99887 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:31.909638 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-83085e0e-910b-4887-a05a-99215df99887 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:31.910888 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-83085e0e-910b-4887-a05a-99215df99887 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:31.911509 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-83085e0e-910b-4887-a05a-99215df99887 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:31.912614 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-83085e0e-910b-4887-a05a-99215df99887 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:31.947433 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=100 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:32.140263 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-83085e0e-910b-4887-a05a-99215df99887 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:32.164707 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-83085e0e-910b-4887-a05a-99215df99887 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1280 microversion: 2.1 time: 0.276401 Oct 26 11:18:32.169956 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 34/65] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:31 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1280 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:32.291682 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-3e598f23-1e2e-46ee-8e20-c57a2e7bd4b9 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:32.311239 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-3e598f23-1e2e-46ee-8e20-c57a2e7bd4b9 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1315 microversion: 2.1 time: 0.950042 Oct 26 11:18:32.311973 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 32/66] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:31 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1315 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:32.388082 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-e0235880-a907-4526-a5a6-2e4712a704f8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:32.389042 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-e0235880-a907-4526-a5a6-2e4712a704f8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:32.410514 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:32.414971 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e0235880-a907-4526-a5a6-2e4712a704f8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:32.419119 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e0235880-a907-4526-a5a6-2e4712a704f8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:32.419119 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e0235880-a907-4526-a5a6-2e4712a704f8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:32.419119 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e0235880-a907-4526-a5a6-2e4712a704f8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:32.424292 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e0235880-a907-4526-a5a6-2e4712a704f8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:32.425050 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e0235880-a907-4526-a5a6-2e4712a704f8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:32.481568 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=100 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:32.710711 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-8afca2fe-7105-4cc3-aaaf-cf42f971363d req-c78ec065-ab06-48c9-bdeb-b5e6d1bc4141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2821a8ff-1cb6-43c5-9968-1c13e293ad1a", "tag": "6cd2d732-48e8-4aca-ac57-8f769619a1f1"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:18:32.758543 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-8afca2fe-7105-4cc3-aaaf-cf42f971363d req-c78ec065-ab06-48c9-bdeb-b5e6d1bc4141 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:32.760467 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-8afca2fe-7105-4cc3-aaaf-cf42f971363d req-c78ec065-ab06-48c9-bdeb-b5e6d1bc4141 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:32.761319 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-8afca2fe-7105-4cc3-aaaf-cf42f971363d req-c78ec065-ab06-48c9-bdeb-b5e6d1bc4141 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:32.819225 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-8afca2fe-7105-4cc3-aaaf-cf42f971363d req-c78ec065-ab06-48c9-bdeb-b5e6d1bc4141 service nova] Creating event network-changed:6cd2d732-48e8-4aca-ac57-8f769619a1f1 for instance 2821a8ff-1cb6-43c5-9968-1c13e293ad1a on hv-cinder-81558 Oct 26 11:18:32.820251 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-8afca2fe-7105-4cc3-aaaf-cf42f971363d req-c78ec065-ab06-48c9-bdeb-b5e6d1bc4141 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=119306) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 26 11:18:32.820970 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-8afca2fe-7105-4cc3-aaaf-cf42f971363d req-c78ec065-ab06-48c9-bdeb-b5e6d1bc4141 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119306) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 26 11:18:32.822257 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4eb53847-85a1-4d5d-87fc-84249f230e49 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:32.823252 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4eb53847-85a1-4d5d-87fc-84249f230e49 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:32.823952 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4eb53847-85a1-4d5d-87fc-84249f230e49 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:32.825624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4eb53847-85a1-4d5d-87fc-84249f230e49 None None] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:32.826369 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4eb53847-85a1-4d5d-87fc-84249f230e49 None None] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:32.827126 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4eb53847-85a1-4d5d-87fc-84249f230e49 None None] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:32.840173 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.compute.rpcapi [None req-4eb53847-85a1-4d5d-87fc-84249f230e49 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 26 11:18:32.841671 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4eb53847-85a1-4d5d-87fc-84249f230e49 None None] Releasing lock "compute-rpcapi-router" {{(pid=119306) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 26 11:18:32.861021 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-4eb53847-85a1-4d5d-87fc-84249f230e49 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.687472 Oct 26 11:18:32.862341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 35/67] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:18:32.870613 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-9605a6fb-878e-4a59-b9dd-95786ff2e33f req-bc42046e-ac82-4a4c-8a4b-6a425f399901 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2f70dba-88ab-42ae-ace7-b95eeac5fcfc", "tag": "9710ecc2-ca47-4ec2-84c2-3aadb85ac335"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:18:32.883307 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-9605a6fb-878e-4a59-b9dd-95786ff2e33f req-bc42046e-ac82-4a4c-8a4b-6a425f399901 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:32.884836 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-9605a6fb-878e-4a59-b9dd-95786ff2e33f req-bc42046e-ac82-4a4c-8a4b-6a425f399901 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:32.885717 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-9605a6fb-878e-4a59-b9dd-95786ff2e33f req-bc42046e-ac82-4a4c-8a4b-6a425f399901 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:32.912603 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-9605a6fb-878e-4a59-b9dd-95786ff2e33f req-bc42046e-ac82-4a4c-8a4b-6a425f399901 service nova] Creating event network-changed:9710ecc2-ca47-4ec2-84c2-3aadb85ac335 for instance f2f70dba-88ab-42ae-ace7-b95eeac5fcfc on hv-cinder-81558 Oct 26 11:18:32.924642 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-9605a6fb-878e-4a59-b9dd-95786ff2e33f req-bc42046e-ac82-4a4c-8a4b-6a425f399901 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059236 Oct 26 11:18:32.926232 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 36/68] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:18:32.957050 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-1084bb25-1a36-4ab2-a98a-f31cd0faabea tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:32.958510 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-1084bb25-1a36-4ab2-a98a-f31cd0faabea tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:32.974290 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1084bb25-1a36-4ab2-a98a-f31cd0faabea tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:32.975333 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1084bb25-1a36-4ab2-a98a-f31cd0faabea tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:32.979127 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1084bb25-1a36-4ab2-a98a-f31cd0faabea tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:32.979939 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1084bb25-1a36-4ab2-a98a-f31cd0faabea tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:32.980552 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1084bb25-1a36-4ab2-a98a-f31cd0faabea tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:32.981203 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1084bb25-1a36-4ab2-a98a-f31cd0faabea tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:33.392475 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-1084bb25-1a36-4ab2-a98a-f31cd0faabea tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:33.408291 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-1084bb25-1a36-4ab2-a98a-f31cd0faabea tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:33.415751 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-1084bb25-1a36-4ab2-a98a-f31cd0faabea tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:33.417241 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-1084bb25-1a36-4ab2-a98a-f31cd0faabea tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1406 microversion: 2.20 time: 0.489437 Oct 26 11:18:33.419177 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 37/69] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:18:32 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1406 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:18:33.434794 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-e0235880-a907-4526-a5a6-2e4712a704f8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:33.435839 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-02d98a9e-3e78-4103-82f3-cb5f18bd80cd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:33.436618 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-02d98a9e-3e78-4103-82f3-cb5f18bd80cd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:33.444739 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-02d98a9e-3e78-4103-82f3-cb5f18bd80cd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:33.446623 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-e0235880-a907-4526-a5a6-2e4712a704f8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1367 microversion: 2.1 time: 1.065509 Oct 26 11:18:33.447328 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-02d98a9e-3e78-4103-82f3-cb5f18bd80cd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:33.447922 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-02d98a9e-3e78-4103-82f3-cb5f18bd80cd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:33.452325 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-02d98a9e-3e78-4103-82f3-cb5f18bd80cd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:33.453031 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-02d98a9e-3e78-4103-82f3-cb5f18bd80cd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:33.453669 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-02d98a9e-3e78-4103-82f3-cb5f18bd80cd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:33.466100 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 33/70] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:32 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1367 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:18:33.480682 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-ae45221a-ae2f-466b-9b65-3eaf7861b2a2 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:33.481457 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-ae45221a-ae2f-466b-9b65-3eaf7861b2a2 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:33.499276 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ae45221a-ae2f-466b-9b65-3eaf7861b2a2 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:33.499557 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ae45221a-ae2f-466b-9b65-3eaf7861b2a2 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:33.500000 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ae45221a-ae2f-466b-9b65-3eaf7861b2a2 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:33.506104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ae45221a-ae2f-466b-9b65-3eaf7861b2a2 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:33.506657 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ae45221a-ae2f-466b-9b65-3eaf7861b2a2 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:33.507206 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ae45221a-ae2f-466b-9b65-3eaf7861b2a2 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:33.623461 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-02d98a9e-3e78-4103-82f3-cb5f18bd80cd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:33.632957 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-02d98a9e-3e78-4103-82f3-cb5f18bd80cd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1280 microversion: 2.1 time: 0.212544 Oct 26 11:18:33.634283 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 38/71] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:33 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1280 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:34.200242 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-ae45221a-ae2f-466b-9b65-3eaf7861b2a2 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:34.219028 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-ae45221a-ae2f-466b-9b65-3eaf7861b2a2 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1315 microversion: 2.1 time: 0.741734 Oct 26 11:18:34.220163 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 34/72] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:33 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1315 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:34.447147 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-fdbc67e0-dd1e-4937-b61a-d08c4bccdccc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:34.453568 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-fdbc67e0-dd1e-4937-b61a-d08c4bccdccc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:34.466448 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fdbc67e0-dd1e-4937-b61a-d08c4bccdccc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:34.469865 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fdbc67e0-dd1e-4937-b61a-d08c4bccdccc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:34.470256 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fdbc67e0-dd1e-4937-b61a-d08c4bccdccc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:34.471017 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fdbc67e0-dd1e-4937-b61a-d08c4bccdccc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:34.471480 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fdbc67e0-dd1e-4937-b61a-d08c4bccdccc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:34.471909 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fdbc67e0-dd1e-4937-b61a-d08c4bccdccc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:34.473961 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-5a1dc619-5c7f-43a8-964e-66590ec4ea92 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:34.474773 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-5a1dc619-5c7f-43a8-964e-66590ec4ea92 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:34.488802 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5a1dc619-5c7f-43a8-964e-66590ec4ea92 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:34.489556 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5a1dc619-5c7f-43a8-964e-66590ec4ea92 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:34.490157 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5a1dc619-5c7f-43a8-964e-66590ec4ea92 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:34.512300 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5a1dc619-5c7f-43a8-964e-66590ec4ea92 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:34.514103 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5a1dc619-5c7f-43a8-964e-66590ec4ea92 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:34.522411 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5a1dc619-5c7f-43a8-964e-66590ec4ea92 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:34.817534 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-fdbc67e0-dd1e-4937-b61a-d08c4bccdccc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:34.827869 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-fdbc67e0-dd1e-4937-b61a-d08c4bccdccc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:34.829623 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-fdbc67e0-dd1e-4937-b61a-d08c4bccdccc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:34.830945 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-fdbc67e0-dd1e-4937-b61a-d08c4bccdccc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1406 microversion: 2.20 time: 0.388151 Oct 26 11:18:34.831664 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 39/73] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:18:34 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1406 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:18:34.837150 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-bd707a09-69ab-4dff-8629-08230eb24a49 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:34.837988 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-bd707a09-69ab-4dff-8629-08230eb24a49 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:34.844057 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bd707a09-69ab-4dff-8629-08230eb24a49 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:34.844844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bd707a09-69ab-4dff-8629-08230eb24a49 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:34.845492 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bd707a09-69ab-4dff-8629-08230eb24a49 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:34.846415 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bd707a09-69ab-4dff-8629-08230eb24a49 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:34.847088 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bd707a09-69ab-4dff-8629-08230eb24a49 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:34.847713 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bd707a09-69ab-4dff-8629-08230eb24a49 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:34.935330 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-5a1dc619-5c7f-43a8-964e-66590ec4ea92 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:34.952350 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-5a1dc619-5c7f-43a8-964e-66590ec4ea92 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1367 microversion: 2.1 time: 0.483896 Oct 26 11:18:34.954338 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 35/74] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:34 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1367 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:18:35.003798 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-bd707a09-69ab-4dff-8629-08230eb24a49 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:35.013693 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-bd707a09-69ab-4dff-8629-08230eb24a49 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1322 microversion: 2.1 time: 0.180586 Oct 26 11:18:35.031148 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 40/75] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:34 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:35.248744 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-f5bae84d-91ac-4358-b8af-ca607c8eab51 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:35.254205 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-f5bae84d-91ac-4358-b8af-ca607c8eab51 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:35.260472 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f5bae84d-91ac-4358-b8af-ca607c8eab51 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:35.261259 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f5bae84d-91ac-4358-b8af-ca607c8eab51 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:35.261931 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f5bae84d-91ac-4358-b8af-ca607c8eab51 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:35.263370 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f5bae84d-91ac-4358-b8af-ca607c8eab51 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:35.264796 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f5bae84d-91ac-4358-b8af-ca607c8eab51 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:35.265440 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f5bae84d-91ac-4358-b8af-ca607c8eab51 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:35.681712 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-f5bae84d-91ac-4358-b8af-ca607c8eab51 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:35.693148 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-f5bae84d-91ac-4358-b8af-ca607c8eab51 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1315 microversion: 2.1 time: 0.450419 Oct 26 11:18:35.694695 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 36/76] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:35 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1315 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:35.860655 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-3f98c4c8-8aa4-4232-9fd2-2cd25310f78c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:35.862206 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-3f98c4c8-8aa4-4232-9fd2-2cd25310f78c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:35.887528 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3f98c4c8-8aa4-4232-9fd2-2cd25310f78c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:35.888019 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3f98c4c8-8aa4-4232-9fd2-2cd25310f78c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:35.888459 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3f98c4c8-8aa4-4232-9fd2-2cd25310f78c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:35.889172 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3f98c4c8-8aa4-4232-9fd2-2cd25310f78c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:35.889625 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3f98c4c8-8aa4-4232-9fd2-2cd25310f78c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:35.890057 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3f98c4c8-8aa4-4232-9fd2-2cd25310f78c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:35.980733 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-87373ea2-d93a-4642-ac59-1dccdd8fb934 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:35.981360 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-87373ea2-d93a-4642-ac59-1dccdd8fb934 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:35.999040 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-87373ea2-d93a-4642-ac59-1dccdd8fb934 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:35.999728 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-87373ea2-d93a-4642-ac59-1dccdd8fb934 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:36.000331 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-87373ea2-d93a-4642-ac59-1dccdd8fb934 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:36.001195 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-87373ea2-d93a-4642-ac59-1dccdd8fb934 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:36.001809 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-87373ea2-d93a-4642-ac59-1dccdd8fb934 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:36.002554 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-87373ea2-d93a-4642-ac59-1dccdd8fb934 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:36.284014 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-3f98c4c8-8aa4-4232-9fd2-2cd25310f78c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:36.299230 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-3f98c4c8-8aa4-4232-9fd2-2cd25310f78c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:36.301356 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-3f98c4c8-8aa4-4232-9fd2-2cd25310f78c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:36.307022 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-3f98c4c8-8aa4-4232-9fd2-2cd25310f78c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1406 microversion: 2.20 time: 0.450979 Oct 26 11:18:36.310233 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 41/77] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:18:35 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1406 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:18:36.315113 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-46ffe8bc-48c8-4a29-9d79-7d9e2df6bea1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:36.316962 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-46ffe8bc-48c8-4a29-9d79-7d9e2df6bea1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:36.333253 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-46ffe8bc-48c8-4a29-9d79-7d9e2df6bea1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:36.334143 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-46ffe8bc-48c8-4a29-9d79-7d9e2df6bea1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:36.334949 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-46ffe8bc-48c8-4a29-9d79-7d9e2df6bea1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:36.335879 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-46ffe8bc-48c8-4a29-9d79-7d9e2df6bea1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:36.337756 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-46ffe8bc-48c8-4a29-9d79-7d9e2df6bea1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:36.340370 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-46ffe8bc-48c8-4a29-9d79-7d9e2df6bea1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:36.406406 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-87373ea2-d93a-4642-ac59-1dccdd8fb934 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:36.420483 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-87373ea2-d93a-4642-ac59-1dccdd8fb934 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1367 microversion: 2.1 time: 0.443343 Oct 26 11:18:36.420763 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 37/78] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:35 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1367 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:18:36.436704 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-8a63a65b-3014-44fb-9764-6a48b456632f req-0b8ac403-fabd-4e9b-ba10-501ce884bd51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c038aa8-5351-4f13-8fc5-32674a0f6dce", "tag": "caf5feb7-a01a-4f65-a03c-f3013b3ab59d"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:18:36.447092 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-8a63a65b-3014-44fb-9764-6a48b456632f req-0b8ac403-fabd-4e9b-ba10-501ce884bd51 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:36.447574 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-8a63a65b-3014-44fb-9764-6a48b456632f req-0b8ac403-fabd-4e9b-ba10-501ce884bd51 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:36.448003 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-8a63a65b-3014-44fb-9764-6a48b456632f req-0b8ac403-fabd-4e9b-ba10-501ce884bd51 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:36.464796 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-8a63a65b-3014-44fb-9764-6a48b456632f req-0b8ac403-fabd-4e9b-ba10-501ce884bd51 service nova] Creating event network-changed:caf5feb7-a01a-4f65-a03c-f3013b3ab59d for instance 5c038aa8-5351-4f13-8fc5-32674a0f6dce on hv-cinder-81558 Oct 26 11:18:36.465299 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-8a63a65b-3014-44fb-9764-6a48b456632f req-0b8ac403-fabd-4e9b-ba10-501ce884bd51 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038805 Oct 26 11:18:36.467126 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 38/79] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:18:36.585387 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-46ffe8bc-48c8-4a29-9d79-7d9e2df6bea1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:36.592977 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-46ffe8bc-48c8-4a29-9d79-7d9e2df6bea1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1322 microversion: 2.1 time: 0.281472 Oct 26 11:18:36.593548 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 42/80] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:36 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:36.723717 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-4b4d6c20-46e6-4f84-9a83-a0214dc1b237 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:36.724765 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-4b4d6c20-46e6-4f84-9a83-a0214dc1b237 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:36.734738 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4b4d6c20-46e6-4f84-9a83-a0214dc1b237 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:36.735410 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4b4d6c20-46e6-4f84-9a83-a0214dc1b237 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:36.737054 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4b4d6c20-46e6-4f84-9a83-a0214dc1b237 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:36.738564 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4b4d6c20-46e6-4f84-9a83-a0214dc1b237 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:36.739934 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4b4d6c20-46e6-4f84-9a83-a0214dc1b237 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:36.741104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4b4d6c20-46e6-4f84-9a83-a0214dc1b237 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:36.888593 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-4b4d6c20-46e6-4f84-9a83-a0214dc1b237 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:36.896359 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-4b4d6c20-46e6-4f84-9a83-a0214dc1b237 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1315 microversion: 2.1 time: 0.179855 Oct 26 11:18:36.896926 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 39/81] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:36 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:37.333264 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-572aa907-3af7-4fbe-a5db-8947129fc9b5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:37.333876 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-572aa907-3af7-4fbe-a5db-8947129fc9b5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:37.340346 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-572aa907-3af7-4fbe-a5db-8947129fc9b5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:37.340827 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-572aa907-3af7-4fbe-a5db-8947129fc9b5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:37.341263 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-572aa907-3af7-4fbe-a5db-8947129fc9b5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:37.341944 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-572aa907-3af7-4fbe-a5db-8947129fc9b5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:37.342394 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-572aa907-3af7-4fbe-a5db-8947129fc9b5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:37.342852 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-572aa907-3af7-4fbe-a5db-8947129fc9b5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:37.445666 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-bfaf9680-8d6e-49c7-b365-16c61b9d89fc tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:37.446934 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-bfaf9680-8d6e-49c7-b365-16c61b9d89fc tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:37.456122 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bfaf9680-8d6e-49c7-b365-16c61b9d89fc tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:37.457942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bfaf9680-8d6e-49c7-b365-16c61b9d89fc tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:37.458602 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bfaf9680-8d6e-49c7-b365-16c61b9d89fc tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:37.460776 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bfaf9680-8d6e-49c7-b365-16c61b9d89fc tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:37.465209 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bfaf9680-8d6e-49c7-b365-16c61b9d89fc tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:37.467197 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bfaf9680-8d6e-49c7-b365-16c61b9d89fc tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:37.487122 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-572aa907-3af7-4fbe-a5db-8947129fc9b5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:37.499070 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-572aa907-3af7-4fbe-a5db-8947129fc9b5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:37.500604 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-572aa907-3af7-4fbe-a5db-8947129fc9b5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:37.501767 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-572aa907-3af7-4fbe-a5db-8947129fc9b5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1406 microversion: 2.20 time: 0.172837 Oct 26 11:18:37.507979 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 43/82] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:18:37 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:18:37.616377 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-4513711f-9bda-4560-a789-8e31d6976adf tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:37.617025 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-4513711f-9bda-4560-a789-8e31d6976adf tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:37.623301 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4513711f-9bda-4560-a789-8e31d6976adf tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:37.623791 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4513711f-9bda-4560-a789-8e31d6976adf tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:37.624221 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4513711f-9bda-4560-a789-8e31d6976adf tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:37.625006 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4513711f-9bda-4560-a789-8e31d6976adf tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:37.625461 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4513711f-9bda-4560-a789-8e31d6976adf tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:37.625881 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4513711f-9bda-4560-a789-8e31d6976adf tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:37.674845 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-bfaf9680-8d6e-49c7-b365-16c61b9d89fc tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:37.682850 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-bfaf9680-8d6e-49c7-b365-16c61b9d89fc tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1367 microversion: 2.1 time: 0.242594 Oct 26 11:18:37.698779 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 40/83] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:37 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1367 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:37.773428 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-4513711f-9bda-4560-a789-8e31d6976adf tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:37.781805 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-4513711f-9bda-4560-a789-8e31d6976adf tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1322 microversion: 2.1 time: 0.169770 Oct 26 11:18:37.796070 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 44/84] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:37 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:18:37.919672 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-01023482-d62a-41b6-a1cb-2d65584ae496 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:37.920293 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-01023482-d62a-41b6-a1cb-2d65584ae496 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:37.926034 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-01023482-d62a-41b6-a1cb-2d65584ae496 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:37.926509 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-01023482-d62a-41b6-a1cb-2d65584ae496 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:37.926985 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-01023482-d62a-41b6-a1cb-2d65584ae496 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:37.927670 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-01023482-d62a-41b6-a1cb-2d65584ae496 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:37.928119 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-01023482-d62a-41b6-a1cb-2d65584ae496 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:37.928536 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-01023482-d62a-41b6-a1cb-2d65584ae496 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:38.069246 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-01023482-d62a-41b6-a1cb-2d65584ae496 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:38.078029 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-01023482-d62a-41b6-a1cb-2d65584ae496 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1315 microversion: 2.1 time: 0.162483 Oct 26 11:18:38.079798 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 41/85] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:37 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:38.484206 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-84b59760-becb-4b0a-905f-90ac670f9e6b req-c3992f58-4db3-4685-8037-adfb56e4e594 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3d343d6-fcf5-4a1b-a077-d2e28d613a70", "tag": "0bd9ab45-c3f2-4623-8bcc-0d43ada4210e"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:18:38.494322 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-84b59760-becb-4b0a-905f-90ac670f9e6b req-c3992f58-4db3-4685-8037-adfb56e4e594 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:38.494799 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-84b59760-becb-4b0a-905f-90ac670f9e6b req-c3992f58-4db3-4685-8037-adfb56e4e594 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:38.495271 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-84b59760-becb-4b0a-905f-90ac670f9e6b req-c3992f58-4db3-4685-8037-adfb56e4e594 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:38.507054 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-84b59760-becb-4b0a-905f-90ac670f9e6b req-c3992f58-4db3-4685-8037-adfb56e4e594 service nova] Creating event network-changed:0bd9ab45-c3f2-4623-8bcc-0d43ada4210e for instance f3d343d6-fcf5-4a1b-a077-d2e28d613a70 on hv-cinder-81558 Oct 26 11:18:38.512386 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-84b59760-becb-4b0a-905f-90ac670f9e6b req-c3992f58-4db3-4685-8037-adfb56e4e594 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031661 Oct 26 11:18:38.512728 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 45/86] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:18:38.527987 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-dfcd889e-7cac-440f-9699-ee1efbcce0ef tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:38.528953 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-dfcd889e-7cac-440f-9699-ee1efbcce0ef tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:38.534974 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-dfcd889e-7cac-440f-9699-ee1efbcce0ef tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:38.535457 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-dfcd889e-7cac-440f-9699-ee1efbcce0ef tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:38.535923 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-dfcd889e-7cac-440f-9699-ee1efbcce0ef tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:38.536676 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-dfcd889e-7cac-440f-9699-ee1efbcce0ef tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:38.537121 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-dfcd889e-7cac-440f-9699-ee1efbcce0ef tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:38.537547 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-dfcd889e-7cac-440f-9699-ee1efbcce0ef tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:38.692993 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-dfcd889e-7cac-440f-9699-ee1efbcce0ef tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:38.710841 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-783fd850-7bb8-46b1-b36e-8791180ee00e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:38.710965 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-783fd850-7bb8-46b1-b36e-8791180ee00e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:38.723388 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-dfcd889e-7cac-440f-9699-ee1efbcce0ef tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:38.725226 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-dfcd889e-7cac-440f-9699-ee1efbcce0ef tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:38.726455 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-dfcd889e-7cac-440f-9699-ee1efbcce0ef tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1406 microversion: 2.20 time: 0.202512 Oct 26 11:18:38.728762 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 42/87] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:18:38 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:18:38.745952 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-783fd850-7bb8-46b1-b36e-8791180ee00e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:38.746640 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-783fd850-7bb8-46b1-b36e-8791180ee00e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:38.747167 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-783fd850-7bb8-46b1-b36e-8791180ee00e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:38.748109 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-783fd850-7bb8-46b1-b36e-8791180ee00e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:38.749433 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-783fd850-7bb8-46b1-b36e-8791180ee00e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:38.749958 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-783fd850-7bb8-46b1-b36e-8791180ee00e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:38.804949 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-0ca7d228-d0b5-4914-94b8-ccc7bd283511 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:38.806345 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-0ca7d228-d0b5-4914-94b8-ccc7bd283511 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:38.812591 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0ca7d228-d0b5-4914-94b8-ccc7bd283511 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:38.813422 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0ca7d228-d0b5-4914-94b8-ccc7bd283511 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:38.813933 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0ca7d228-d0b5-4914-94b8-ccc7bd283511 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:38.814619 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0ca7d228-d0b5-4914-94b8-ccc7bd283511 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:38.815139 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0ca7d228-d0b5-4914-94b8-ccc7bd283511 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:38.815681 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0ca7d228-d0b5-4914-94b8-ccc7bd283511 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:38.954534 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-783fd850-7bb8-46b1-b36e-8791180ee00e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:38.965726 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-783fd850-7bb8-46b1-b36e-8791180ee00e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1367 microversion: 2.1 time: 0.263299 Oct 26 11:18:38.978971 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 46/88] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:38 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:39.014700 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-0ca7d228-d0b5-4914-94b8-ccc7bd283511 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:39.014700 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-0ca7d228-d0b5-4914-94b8-ccc7bd283511 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1322 microversion: 2.1 time: 0.212191 Oct 26 11:18:39.014700 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 43/89] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:38 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:18:39.102226 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-46f3f4a4-9566-4ba4-a2ff-ddba70afd2e9 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:39.103442 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-46f3f4a4-9566-4ba4-a2ff-ddba70afd2e9 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:39.109450 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-46f3f4a4-9566-4ba4-a2ff-ddba70afd2e9 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:39.110291 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-46f3f4a4-9566-4ba4-a2ff-ddba70afd2e9 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:39.110410 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-46f3f4a4-9566-4ba4-a2ff-ddba70afd2e9 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:39.111056 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-46f3f4a4-9566-4ba4-a2ff-ddba70afd2e9 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:39.111539 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-46f3f4a4-9566-4ba4-a2ff-ddba70afd2e9 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:39.111958 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-46f3f4a4-9566-4ba4-a2ff-ddba70afd2e9 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:39.255768 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-46f3f4a4-9566-4ba4-a2ff-ddba70afd2e9 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:39.265508 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-46f3f4a4-9566-4ba4-a2ff-ddba70afd2e9 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1315 microversion: 2.1 time: 0.167125 Oct 26 11:18:39.282194 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 47/90] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:39 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:39.753492 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-b0571c06-5e0a-461e-8430-f5a12d5b5d8b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:39.754137 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-b0571c06-5e0a-461e-8430-f5a12d5b5d8b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:39.807363 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell0:SELECT=6 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:39.807363 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b0571c06-5e0a-461e-8430-f5a12d5b5d8b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:39.807363 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b0571c06-5e0a-461e-8430-f5a12d5b5d8b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:39.807363 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b0571c06-5e0a-461e-8430-f5a12d5b5d8b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:39.807715 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b0571c06-5e0a-461e-8430-f5a12d5b5d8b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:39.807715 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b0571c06-5e0a-461e-8430-f5a12d5b5d8b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:39.807715 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b0571c06-5e0a-461e-8430-f5a12d5b5d8b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:39.895252 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-b0571c06-5e0a-461e-8430-f5a12d5b5d8b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:39.903893 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-b0571c06-5e0a-461e-8430-f5a12d5b5d8b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:39.905306 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-b0571c06-5e0a-461e-8430-f5a12d5b5d8b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:39.906401 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-b0571c06-5e0a-461e-8430-f5a12d5b5d8b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1406 microversion: 2.20 time: 0.156871 Oct 26 11:18:39.906984 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 44/91] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:18:39 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:18:39.989337 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-fa215891-b710-4b38-8972-4b045fba49f6 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:39.989944 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-fa215891-b710-4b38-8972-4b045fba49f6 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:39.995858 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fa215891-b710-4b38-8972-4b045fba49f6 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:39.996337 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fa215891-b710-4b38-8972-4b045fba49f6 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:39.996821 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fa215891-b710-4b38-8972-4b045fba49f6 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:39.997451 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fa215891-b710-4b38-8972-4b045fba49f6 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:39.997900 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fa215891-b710-4b38-8972-4b045fba49f6 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:39.998319 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fa215891-b710-4b38-8972-4b045fba49f6 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:40.036891 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-99cac685-5af8-4bfb-a1c9-0622e15c8501 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:40.037504 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-99cac685-5af8-4bfb-a1c9-0622e15c8501 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:40.043718 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-99cac685-5af8-4bfb-a1c9-0622e15c8501 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:40.044198 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-99cac685-5af8-4bfb-a1c9-0622e15c8501 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:40.044634 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-99cac685-5af8-4bfb-a1c9-0622e15c8501 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:40.045343 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-99cac685-5af8-4bfb-a1c9-0622e15c8501 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:40.045796 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-99cac685-5af8-4bfb-a1c9-0622e15c8501 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:40.046214 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-99cac685-5af8-4bfb-a1c9-0622e15c8501 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:40.147703 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-fa215891-b710-4b38-8972-4b045fba49f6 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:40.158383 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-fa215891-b710-4b38-8972-4b045fba49f6 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1367 microversion: 2.1 time: 0.172867 Oct 26 11:18:40.164003 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 48/92] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:39 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:40.183326 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-99cac685-5af8-4bfb-a1c9-0622e15c8501 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:40.191013 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-99cac685-5af8-4bfb-a1c9-0622e15c8501 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1322 microversion: 2.1 time: 0.157928 Oct 26 11:18:40.191576 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 45/93] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:40 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:18:40.289422 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-a116a4c2-6e96-4cc9-b403-bb0d6c962b49 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:40.290025 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-a116a4c2-6e96-4cc9-b403-bb0d6c962b49 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:40.296222 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a116a4c2-6e96-4cc9-b403-bb0d6c962b49 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:40.296697 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a116a4c2-6e96-4cc9-b403-bb0d6c962b49 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:40.297130 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a116a4c2-6e96-4cc9-b403-bb0d6c962b49 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:40.297806 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a116a4c2-6e96-4cc9-b403-bb0d6c962b49 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:40.298248 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a116a4c2-6e96-4cc9-b403-bb0d6c962b49 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:40.298663 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a116a4c2-6e96-4cc9-b403-bb0d6c962b49 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:40.424043 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-a116a4c2-6e96-4cc9-b403-bb0d6c962b49 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:40.432223 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-a116a4c2-6e96-4cc9-b403-bb0d6c962b49 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1315 microversion: 2.1 time: 0.146629 Oct 26 11:18:40.432789 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 49/94] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:40 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:40.938504 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-aacf119c-7288-42cf-b7cf-361e67912396 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:40.939249 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-aacf119c-7288-42cf-b7cf-361e67912396 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:40.945896 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-aacf119c-7288-42cf-b7cf-361e67912396 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:40.946397 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-aacf119c-7288-42cf-b7cf-361e67912396 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:40.946897 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-aacf119c-7288-42cf-b7cf-361e67912396 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:40.947604 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-aacf119c-7288-42cf-b7cf-361e67912396 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:40.948064 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-aacf119c-7288-42cf-b7cf-361e67912396 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:40.948563 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-aacf119c-7288-42cf-b7cf-361e67912396 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:41.108752 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-aacf119c-7288-42cf-b7cf-361e67912396 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:41.118267 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-aacf119c-7288-42cf-b7cf-361e67912396 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:41.119894 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-aacf119c-7288-42cf-b7cf-361e67912396 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:41.121014 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-aacf119c-7288-42cf-b7cf-361e67912396 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1406 microversion: 2.20 time: 0.186693 Oct 26 11:18:41.121577 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 46/95] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:18:40 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:18:41.186549 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-0ea799ce-5a91-4635-a74e-a82475d4c568 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:41.187707 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-0ea799ce-5a91-4635-a74e-a82475d4c568 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:41.198224 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0ea799ce-5a91-4635-a74e-a82475d4c568 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:41.198925 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0ea799ce-5a91-4635-a74e-a82475d4c568 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:41.200762 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0ea799ce-5a91-4635-a74e-a82475d4c568 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:41.200762 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0ea799ce-5a91-4635-a74e-a82475d4c568 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:41.200762 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0ea799ce-5a91-4635-a74e-a82475d4c568 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:41.201347 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0ea799ce-5a91-4635-a74e-a82475d4c568 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:41.218986 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-d036d9b9-e389-402c-bbec-fcccb9b7e2ca tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:41.220934 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-d036d9b9-e389-402c-bbec-fcccb9b7e2ca tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:41.231021 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d036d9b9-e389-402c-bbec-fcccb9b7e2ca tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:41.231574 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d036d9b9-e389-402c-bbec-fcccb9b7e2ca tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:41.232022 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d036d9b9-e389-402c-bbec-fcccb9b7e2ca tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:41.233267 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d036d9b9-e389-402c-bbec-fcccb9b7e2ca tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:41.233792 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d036d9b9-e389-402c-bbec-fcccb9b7e2ca tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:41.240295 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d036d9b9-e389-402c-bbec-fcccb9b7e2ca tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:41.369392 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-0ea799ce-5a91-4635-a74e-a82475d4c568 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:41.379855 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-0ea799ce-5a91-4635-a74e-a82475d4c568 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1367 microversion: 2.1 time: 0.200748 Oct 26 11:18:41.382921 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 50/96] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:41 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:18:41.386676 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-d036d9b9-e389-402c-bbec-fcccb9b7e2ca tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:41.400347 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-d036d9b9-e389-402c-bbec-fcccb9b7e2ca tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1322 microversion: 2.1 time: 0.185310 Oct 26 11:18:41.400347 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 47/97] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:41 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:41.458570 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-b9ed76b7-2044-4f01-a1ea-367b9c5116f8 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:41.459235 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-b9ed76b7-2044-4f01-a1ea-367b9c5116f8 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:41.466649 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b9ed76b7-2044-4f01-a1ea-367b9c5116f8 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:41.467167 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b9ed76b7-2044-4f01-a1ea-367b9c5116f8 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:41.467607 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b9ed76b7-2044-4f01-a1ea-367b9c5116f8 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:41.468307 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b9ed76b7-2044-4f01-a1ea-367b9c5116f8 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:41.468765 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b9ed76b7-2044-4f01-a1ea-367b9c5116f8 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:41.469263 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b9ed76b7-2044-4f01-a1ea-367b9c5116f8 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:41.618576 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-b9ed76b7-2044-4f01-a1ea-367b9c5116f8 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:41.626495 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-b9ed76b7-2044-4f01-a1ea-367b9c5116f8 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1315 microversion: 2.1 time: 0.174516 Oct 26 11:18:41.627097 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 51/98] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:41 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:42.145512 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-4d183d78-eda8-4211-a6d7-ff85eb451229 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:42.146293 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-4d183d78-eda8-4211-a6d7-ff85eb451229 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:42.152190 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4d183d78-eda8-4211-a6d7-ff85eb451229 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:42.152670 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4d183d78-eda8-4211-a6d7-ff85eb451229 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:42.153322 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4d183d78-eda8-4211-a6d7-ff85eb451229 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:42.154024 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4d183d78-eda8-4211-a6d7-ff85eb451229 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:42.154476 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4d183d78-eda8-4211-a6d7-ff85eb451229 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:42.154927 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4d183d78-eda8-4211-a6d7-ff85eb451229 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:42.309842 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-4d183d78-eda8-4211-a6d7-ff85eb451229 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:42.332525 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-4d183d78-eda8-4211-a6d7-ff85eb451229 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:42.334107 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-4d183d78-eda8-4211-a6d7-ff85eb451229 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:42.335317 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-4d183d78-eda8-4211-a6d7-ff85eb451229 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1406 microversion: 2.20 time: 0.193782 Oct 26 11:18:42.335889 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 48/99] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:18:42 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:18:42.403928 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-b63a8eb9-3965-4bd7-b92e-967f999f68f2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:42.404815 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-b63a8eb9-3965-4bd7-b92e-967f999f68f2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:42.415453 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b63a8eb9-3965-4bd7-b92e-967f999f68f2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:42.416194 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b63a8eb9-3965-4bd7-b92e-967f999f68f2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:42.418939 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b63a8eb9-3965-4bd7-b92e-967f999f68f2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:42.419808 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b63a8eb9-3965-4bd7-b92e-967f999f68f2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:42.421507 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b63a8eb9-3965-4bd7-b92e-967f999f68f2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:42.421630 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-856150f5-409a-45db-bbfe-f96396d5a6af tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:42.422154 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-856150f5-409a-45db-bbfe-f96396d5a6af tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:42.422795 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b63a8eb9-3965-4bd7-b92e-967f999f68f2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:42.428485 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-856150f5-409a-45db-bbfe-f96396d5a6af tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:42.428975 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-856150f5-409a-45db-bbfe-f96396d5a6af tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:42.429411 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-856150f5-409a-45db-bbfe-f96396d5a6af tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:42.430494 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-856150f5-409a-45db-bbfe-f96396d5a6af tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:42.430982 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-856150f5-409a-45db-bbfe-f96396d5a6af tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:42.432328 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-856150f5-409a-45db-bbfe-f96396d5a6af tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:42.622987 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-b63a8eb9-3965-4bd7-b92e-967f999f68f2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:42.627063 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=100 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:42.632639 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-856150f5-409a-45db-bbfe-f96396d5a6af tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:42.633019 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-b63a8eb9-3965-4bd7-b92e-967f999f68f2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1367 microversion: 2.1 time: 0.233827 Oct 26 11:18:42.644057 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 52/100] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:42 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:42.644142 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-856150f5-409a-45db-bbfe-f96396d5a6af tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1322 microversion: 2.1 time: 0.224489 Oct 26 11:18:42.644142 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 49/101] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:42 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:18:42.676618 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-fbc426e9-2a16-44c3-95b9-023a9231bf06 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:42.677344 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-fbc426e9-2a16-44c3-95b9-023a9231bf06 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:42.703514 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fbc426e9-2a16-44c3-95b9-023a9231bf06 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:42.704015 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fbc426e9-2a16-44c3-95b9-023a9231bf06 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:42.704454 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fbc426e9-2a16-44c3-95b9-023a9231bf06 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:42.705158 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fbc426e9-2a16-44c3-95b9-023a9231bf06 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:42.713419 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fbc426e9-2a16-44c3-95b9-023a9231bf06 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:42.713419 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fbc426e9-2a16-44c3-95b9-023a9231bf06 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:42.837209 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell0:SELECT=2 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:42.893235 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-fbc426e9-2a16-44c3-95b9-023a9231bf06 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:42.895447 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-a513adba-9c10-4e15-beed-a7f864b26add req-3cb87372-2166-448c-98f3-527446a2e3b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db7d6af-35ae-45dd-922d-ee3f0251f4be", "name": "network-vif-plugged", "status": "completed", "tag": "20595fc6-a44c-4ee8-ae66-ce10051ef26d"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:18:42.902187 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-fbc426e9-2a16-44c3-95b9-023a9231bf06 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1315 microversion: 2.1 time: 0.246563 Oct 26 11:18:42.902772 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 53/102] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:42 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:42.906855 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-a513adba-9c10-4e15-beed-a7f864b26add req-3cb87372-2166-448c-98f3-527446a2e3b0 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:42.907488 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-a513adba-9c10-4e15-beed-a7f864b26add req-3cb87372-2166-448c-98f3-527446a2e3b0 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:42.907915 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-a513adba-9c10-4e15-beed-a7f864b26add req-3cb87372-2166-448c-98f3-527446a2e3b0 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:42.919840 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-a513adba-9c10-4e15-beed-a7f864b26add req-3cb87372-2166-448c-98f3-527446a2e3b0 service nova] Creating event network-vif-plugged:20595fc6-a44c-4ee8-ae66-ce10051ef26d for instance 3db7d6af-35ae-45dd-922d-ee3f0251f4be on hv-cinder-81558 Oct 26 11:18:42.924918 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-a513adba-9c10-4e15-beed-a7f864b26add req-3cb87372-2166-448c-98f3-527446a2e3b0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093257 Oct 26 11:18:42.925505 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 50/103] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:18:43.360470 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-1361acb2-2d60-443a-bc35-5df7e2eb1dcf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:43.361079 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-1361acb2-2d60-443a-bc35-5df7e2eb1dcf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:43.368154 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1361acb2-2d60-443a-bc35-5df7e2eb1dcf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:43.368674 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1361acb2-2d60-443a-bc35-5df7e2eb1dcf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:43.369630 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1361acb2-2d60-443a-bc35-5df7e2eb1dcf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:43.370321 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1361acb2-2d60-443a-bc35-5df7e2eb1dcf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:43.370767 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1361acb2-2d60-443a-bc35-5df7e2eb1dcf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:43.371221 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1361acb2-2d60-443a-bc35-5df7e2eb1dcf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:43.626770 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-1361acb2-2d60-443a-bc35-5df7e2eb1dcf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:43.640675 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-1361acb2-2d60-443a-bc35-5df7e2eb1dcf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:43.647615 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-1361acb2-2d60-443a-bc35-5df7e2eb1dcf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:43.647615 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-1361acb2-2d60-443a-bc35-5df7e2eb1dcf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1406 microversion: 2.20 time: 0.287340 Oct 26 11:18:43.647615 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 54/104] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:18:43 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1406 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:18:43.671845 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-d413cede-a088-46a2-ac91-3f7484463cf6 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:43.673184 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-d413cede-a088-46a2-ac91-3f7484463cf6 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:43.684500 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-81b2f3ba-9da7-4599-b20a-a52ed4cfd164 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:43.685333 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-81b2f3ba-9da7-4599-b20a-a52ed4cfd164 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:43.688171 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d413cede-a088-46a2-ac91-3f7484463cf6 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:43.689030 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d413cede-a088-46a2-ac91-3f7484463cf6 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:43.689689 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d413cede-a088-46a2-ac91-3f7484463cf6 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:43.692764 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-81b2f3ba-9da7-4599-b20a-a52ed4cfd164 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:43.693455 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-81b2f3ba-9da7-4599-b20a-a52ed4cfd164 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:43.693607 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d413cede-a088-46a2-ac91-3f7484463cf6 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:43.694136 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d413cede-a088-46a2-ac91-3f7484463cf6 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:43.694262 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-81b2f3ba-9da7-4599-b20a-a52ed4cfd164 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:43.694663 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d413cede-a088-46a2-ac91-3f7484463cf6 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:43.695057 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-81b2f3ba-9da7-4599-b20a-a52ed4cfd164 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:43.695700 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-81b2f3ba-9da7-4599-b20a-a52ed4cfd164 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:43.696210 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-81b2f3ba-9da7-4599-b20a-a52ed4cfd164 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:43.703156 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=100 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:44.003694 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-81b2f3ba-9da7-4599-b20a-a52ed4cfd164 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:44.026630 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-81b2f3ba-9da7-4599-b20a-a52ed4cfd164 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1367 microversion: 2.1 time: 0.351735 Oct 26 11:18:44.031279 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 55/105] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:43 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1367 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:44.055919 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-bc6fbf54-3d83-4cb1-a6fa-27184def3590 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:44.057624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-bc6fbf54-3d83-4cb1-a6fa-27184def3590 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:44.077859 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf54-3d83-4cb1-a6fa-27184def3590 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:44.082980 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf54-3d83-4cb1-a6fa-27184def3590 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:44.082980 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf54-3d83-4cb1-a6fa-27184def3590 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:44.082980 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf54-3d83-4cb1-a6fa-27184def3590 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:44.082980 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf54-3d83-4cb1-a6fa-27184def3590 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:44.083372 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bc6fbf54-3d83-4cb1-a6fa-27184def3590 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:44.083442 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-d413cede-a088-46a2-ac91-3f7484463cf6 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:44.095194 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-d413cede-a088-46a2-ac91-3f7484463cf6 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1322 microversion: 2.1 time: 0.429065 Oct 26 11:18:44.095790 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 51/106] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:43 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1322 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:44.362523 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-bc6fbf54-3d83-4cb1-a6fa-27184def3590 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:44.371374 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-bc6fbf54-3d83-4cb1-a6fa-27184def3590 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1315 microversion: 2.1 time: 0.338881 Oct 26 11:18:44.387095 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 56/107] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:44 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:44.672077 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-bf0897b5-286b-4397-9906-785788b8b166 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:44.672699 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-bf0897b5-286b-4397-9906-785788b8b166 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:44.678733 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bf0897b5-286b-4397-9906-785788b8b166 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:44.679248 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bf0897b5-286b-4397-9906-785788b8b166 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:44.679684 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bf0897b5-286b-4397-9906-785788b8b166 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:44.680373 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bf0897b5-286b-4397-9906-785788b8b166 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:44.680892 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bf0897b5-286b-4397-9906-785788b8b166 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:44.681318 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bf0897b5-286b-4397-9906-785788b8b166 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:44.941021 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-a5c57ef4-dcaf-453d-928f-1f6c2bd5e156 req-b605b593-f510-4f44-85d0-18e078c7cf36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2821a8ff-1cb6-43c5-9968-1c13e293ad1a", "name": "network-vif-plugged", "status": "completed", "tag": "6cd2d732-48e8-4aca-ac57-8f769619a1f1"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:18:44.953438 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-a5c57ef4-dcaf-453d-928f-1f6c2bd5e156 req-b605b593-f510-4f44-85d0-18e078c7cf36 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:44.953438 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-a5c57ef4-dcaf-453d-928f-1f6c2bd5e156 req-b605b593-f510-4f44-85d0-18e078c7cf36 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:44.953438 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-a5c57ef4-dcaf-453d-928f-1f6c2bd5e156 req-b605b593-f510-4f44-85d0-18e078c7cf36 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:44.964035 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-a5c57ef4-dcaf-453d-928f-1f6c2bd5e156 req-b605b593-f510-4f44-85d0-18e078c7cf36 service nova] Creating event network-vif-plugged:6cd2d732-48e8-4aca-ac57-8f769619a1f1 for instance 2821a8ff-1cb6-43c5-9968-1c13e293ad1a on hv-cinder-81558 Oct 26 11:18:44.969138 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-a5c57ef4-dcaf-453d-928f-1f6c2bd5e156 req-b605b593-f510-4f44-85d0-18e078c7cf36 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031782 Oct 26 11:18:44.969911 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 57/108] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:18:45.033669 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-bf0897b5-286b-4397-9906-785788b8b166 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:45.042621 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-bf0897b5-286b-4397-9906-785788b8b166 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:45.044118 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-bf0897b5-286b-4397-9906-785788b8b166 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:45.045225 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-bf0897b5-286b-4397-9906-785788b8b166 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1406 microversion: 2.20 time: 0.377474 Oct 26 11:18:45.045782 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 52/109] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:18:44 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1406 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:18:45.066061 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-9b77e64b-1774-4e5f-a24e-878a632f5955 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:45.066873 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-9b77e64b-1774-4e5f-a24e-878a632f5955 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:45.072900 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9b77e64b-1774-4e5f-a24e-878a632f5955 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:45.073379 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9b77e64b-1774-4e5f-a24e-878a632f5955 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:45.073844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9b77e64b-1774-4e5f-a24e-878a632f5955 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:45.074508 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9b77e64b-1774-4e5f-a24e-878a632f5955 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:45.074974 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9b77e64b-1774-4e5f-a24e-878a632f5955 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:45.075395 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9b77e64b-1774-4e5f-a24e-878a632f5955 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:45.120217 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-bdd94a7e-a168-4d0a-a050-2d99a41a4f77 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:45.120835 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-bdd94a7e-a168-4d0a-a050-2d99a41a4f77 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:45.126925 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bdd94a7e-a168-4d0a-a050-2d99a41a4f77 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:45.127414 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bdd94a7e-a168-4d0a-a050-2d99a41a4f77 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:45.127857 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bdd94a7e-a168-4d0a-a050-2d99a41a4f77 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:45.128549 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bdd94a7e-a168-4d0a-a050-2d99a41a4f77 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:45.129015 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bdd94a7e-a168-4d0a-a050-2d99a41a4f77 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:45.129445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bdd94a7e-a168-4d0a-a050-2d99a41a4f77 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:45.209349 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-9b77e64b-1774-4e5f-a24e-878a632f5955 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:45.218257 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-9b77e64b-1774-4e5f-a24e-878a632f5955 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1367 microversion: 2.1 time: 0.156330 Oct 26 11:18:45.218933 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 58/110] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:45 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:45.272604 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-bdd94a7e-a168-4d0a-a050-2d99a41a4f77 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:45.289891 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-bdd94a7e-a168-4d0a-a050-2d99a41a4f77 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1322 microversion: 2.1 time: 0.173393 Oct 26 11:18:45.290485 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 53/111] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:45 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:18:45.394628 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-bb5a2f03-e17b-4ff3-a225-e02255deaa82 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:45.395277 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-bb5a2f03-e17b-4ff3-a225-e02255deaa82 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:45.401896 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bb5a2f03-e17b-4ff3-a225-e02255deaa82 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:45.402397 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bb5a2f03-e17b-4ff3-a225-e02255deaa82 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:45.402838 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bb5a2f03-e17b-4ff3-a225-e02255deaa82 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:45.403710 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bb5a2f03-e17b-4ff3-a225-e02255deaa82 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:45.404168 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bb5a2f03-e17b-4ff3-a225-e02255deaa82 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:45.404589 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bb5a2f03-e17b-4ff3-a225-e02255deaa82 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:45.535410 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-bb5a2f03-e17b-4ff3-a225-e02255deaa82 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:45.546780 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-bb5a2f03-e17b-4ff3-a225-e02255deaa82 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1315 microversion: 2.1 time: 0.155935 Oct 26 11:18:45.547396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 59/112] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:45 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:46.070137 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-0c0647f2-6ca8-485c-8733-26f6a44fb3c8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:46.070744 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-0c0647f2-6ca8-485c-8733-26f6a44fb3c8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:46.076788 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0c0647f2-6ca8-485c-8733-26f6a44fb3c8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:46.077269 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0c0647f2-6ca8-485c-8733-26f6a44fb3c8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:46.077844 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0c0647f2-6ca8-485c-8733-26f6a44fb3c8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:46.078554 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0c0647f2-6ca8-485c-8733-26f6a44fb3c8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:46.079030 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0c0647f2-6ca8-485c-8733-26f6a44fb3c8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:46.079489 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0c0647f2-6ca8-485c-8733-26f6a44fb3c8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:46.227632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-0c0647f2-6ca8-485c-8733-26f6a44fb3c8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:46.240874 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-7048fb0b-112b-44b1-a4e9-c0748d071339 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:46.241819 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-7048fb0b-112b-44b1-a4e9-c0748d071339 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:46.248817 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7048fb0b-112b-44b1-a4e9-c0748d071339 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:46.249298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7048fb0b-112b-44b1-a4e9-c0748d071339 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:46.249763 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7048fb0b-112b-44b1-a4e9-c0748d071339 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:46.250018 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-0c0647f2-6ca8-485c-8733-26f6a44fb3c8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:46.250501 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7048fb0b-112b-44b1-a4e9-c0748d071339 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:46.251054 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7048fb0b-112b-44b1-a4e9-c0748d071339 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:46.251472 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7048fb0b-112b-44b1-a4e9-c0748d071339 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:46.251592 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-0c0647f2-6ca8-485c-8733-26f6a44fb3c8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:46.252652 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-0c0647f2-6ca8-485c-8733-26f6a44fb3c8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1406 microversion: 2.20 time: 0.186702 Oct 26 11:18:46.253218 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 54/113] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:18:46 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:18:46.318039 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-19adde31-2a16-4f45-a348-60dda99f76f2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:46.318592 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-19adde31-2a16-4f45-a348-60dda99f76f2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:46.329299 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-19adde31-2a16-4f45-a348-60dda99f76f2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:46.330042 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-19adde31-2a16-4f45-a348-60dda99f76f2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:46.331309 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-19adde31-2a16-4f45-a348-60dda99f76f2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:46.332126 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-19adde31-2a16-4f45-a348-60dda99f76f2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:46.332686 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-19adde31-2a16-4f45-a348-60dda99f76f2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:46.333380 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-19adde31-2a16-4f45-a348-60dda99f76f2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:46.418130 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-7048fb0b-112b-44b1-a4e9-c0748d071339 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:46.426093 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-7048fb0b-112b-44b1-a4e9-c0748d071339 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1367 microversion: 2.1 time: 0.188993 Oct 26 11:18:46.441213 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 60/114] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:46 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:18:46.480266 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-19adde31-2a16-4f45-a348-60dda99f76f2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:46.488060 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-19adde31-2a16-4f45-a348-60dda99f76f2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1322 microversion: 2.1 time: 0.174265 Oct 26 11:18:46.488631 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 55/115] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:46 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:18:46.572428 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-700a09b2-412b-413f-b525-95a954109696 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:46.572966 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-700a09b2-412b-413f-b525-95a954109696 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:46.578951 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-700a09b2-412b-413f-b525-95a954109696 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:46.579439 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-700a09b2-412b-413f-b525-95a954109696 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:46.579867 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-700a09b2-412b-413f-b525-95a954109696 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:46.580715 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-700a09b2-412b-413f-b525-95a954109696 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:46.581165 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-700a09b2-412b-413f-b525-95a954109696 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:46.581583 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-700a09b2-412b-413f-b525-95a954109696 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:46.875362 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-700a09b2-412b-413f-b525-95a954109696 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:46.884211 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-700a09b2-412b-413f-b525-95a954109696 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1315 microversion: 2.1 time: 0.315590 Oct 26 11:18:46.884795 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 61/116] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:46 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:47.280660 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-7539408b-d3b5-46d4-98c8-4edb3b81c774 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:47.280660 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-7539408b-d3b5-46d4-98c8-4edb3b81c774 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:47.288293 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7539408b-d3b5-46d4-98c8-4edb3b81c774 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:47.288779 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7539408b-d3b5-46d4-98c8-4edb3b81c774 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:47.289215 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7539408b-d3b5-46d4-98c8-4edb3b81c774 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:47.289943 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7539408b-d3b5-46d4-98c8-4edb3b81c774 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:47.290393 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7539408b-d3b5-46d4-98c8-4edb3b81c774 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:47.290831 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7539408b-d3b5-46d4-98c8-4edb3b81c774 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:47.449686 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-eaef8e79-7799-4d60-a616-3806ee634088 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:47.450387 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-eaef8e79-7799-4d60-a616-3806ee634088 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:47.456292 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-eaef8e79-7799-4d60-a616-3806ee634088 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:47.463560 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-eaef8e79-7799-4d60-a616-3806ee634088 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:47.463560 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-eaef8e79-7799-4d60-a616-3806ee634088 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:47.463751 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-7539408b-d3b5-46d4-98c8-4edb3b81c774 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:47.463854 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-eaef8e79-7799-4d60-a616-3806ee634088 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:47.463854 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-eaef8e79-7799-4d60-a616-3806ee634088 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:47.463854 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-eaef8e79-7799-4d60-a616-3806ee634088 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:47.465764 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-7539408b-d3b5-46d4-98c8-4edb3b81c774 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:47.467228 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-7539408b-d3b5-46d4-98c8-4edb3b81c774 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:47.468329 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-7539408b-d3b5-46d4-98c8-4edb3b81c774 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1406 microversion: 2.20 time: 0.193154 Oct 26 11:18:47.468892 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 56/117] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:18:47 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:18:47.510689 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-8082ee77-deb2-4c04-9c1c-1a223036e7c0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:47.511338 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-8082ee77-deb2-4c04-9c1c-1a223036e7c0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:47.518013 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8082ee77-deb2-4c04-9c1c-1a223036e7c0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:47.518507 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8082ee77-deb2-4c04-9c1c-1a223036e7c0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:47.518985 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8082ee77-deb2-4c04-9c1c-1a223036e7c0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:47.519689 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8082ee77-deb2-4c04-9c1c-1a223036e7c0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:47.520141 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8082ee77-deb2-4c04-9c1c-1a223036e7c0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:47.520564 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8082ee77-deb2-4c04-9c1c-1a223036e7c0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:47.625212 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-eaef8e79-7799-4d60-a616-3806ee634088 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:47.636585 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-eaef8e79-7799-4d60-a616-3806ee634088 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1367 microversion: 2.1 time: 0.191104 Oct 26 11:18:47.646299 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 62/118] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:47 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:18:47.689081 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-8082ee77-deb2-4c04-9c1c-1a223036e7c0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:47.696628 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-8082ee77-deb2-4c04-9c1c-1a223036e7c0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1322 microversion: 2.1 time: 0.189758 Oct 26 11:18:47.697199 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 57/119] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:47 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:18:47.911102 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-4f26ba34-f956-4adc-b232-b59a26cd4c42 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:47.918439 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-4f26ba34-f956-4adc-b232-b59a26cd4c42 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:47.919369 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4f26ba34-f956-4adc-b232-b59a26cd4c42 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:47.920054 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4f26ba34-f956-4adc-b232-b59a26cd4c42 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:47.920776 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4f26ba34-f956-4adc-b232-b59a26cd4c42 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:47.921581 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4f26ba34-f956-4adc-b232-b59a26cd4c42 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:47.922256 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4f26ba34-f956-4adc-b232-b59a26cd4c42 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:47.922934 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4f26ba34-f956-4adc-b232-b59a26cd4c42 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:48.065129 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-4f26ba34-f956-4adc-b232-b59a26cd4c42 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:48.072624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-4f26ba34-f956-4adc-b232-b59a26cd4c42 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1315 microversion: 2.1 time: 0.168001 Oct 26 11:18:48.073229 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 63/120] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:47 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:48.495188 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-b7913ed2-3a25-49e5-b614-f66c2f43f971 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:48.495852 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-b7913ed2-3a25-49e5-b614-f66c2f43f971 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:48.502239 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b7913ed2-3a25-49e5-b614-f66c2f43f971 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:48.502645 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b7913ed2-3a25-49e5-b614-f66c2f43f971 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:48.503119 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b7913ed2-3a25-49e5-b614-f66c2f43f971 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:48.503833 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b7913ed2-3a25-49e5-b614-f66c2f43f971 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:48.504279 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b7913ed2-3a25-49e5-b614-f66c2f43f971 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:48.504694 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b7913ed2-3a25-49e5-b614-f66c2f43f971 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:48.655419 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-b7913ed2-3a25-49e5-b614-f66c2f43f971 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:48.659564 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-7810ddcb-d9db-4d61-878b-4924b17d14e9 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:48.660173 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-7810ddcb-d9db-4d61-878b-4924b17d14e9 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:48.663888 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-b7913ed2-3a25-49e5-b614-f66c2f43f971 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:48.665387 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-b7913ed2-3a25-49e5-b614-f66c2f43f971 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:48.665989 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7810ddcb-d9db-4d61-878b-4924b17d14e9 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:48.666469 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7810ddcb-d9db-4d61-878b-4924b17d14e9 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:48.666727 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-b7913ed2-3a25-49e5-b614-f66c2f43f971 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1406 microversion: 2.20 time: 0.177065 Oct 26 11:18:48.666971 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7810ddcb-d9db-4d61-878b-4924b17d14e9 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:48.667669 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 58/121] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:18:48 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:18:48.671615 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7810ddcb-d9db-4d61-878b-4924b17d14e9 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:48.672309 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7810ddcb-d9db-4d61-878b-4924b17d14e9 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:48.672895 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7810ddcb-d9db-4d61-878b-4924b17d14e9 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:48.720810 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-f214efa4-cde2-4e91-931a-56cf0e382289 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:48.721837 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-f214efa4-cde2-4e91-931a-56cf0e382289 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:48.734199 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f214efa4-cde2-4e91-931a-56cf0e382289 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:48.734692 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f214efa4-cde2-4e91-931a-56cf0e382289 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:48.737416 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f214efa4-cde2-4e91-931a-56cf0e382289 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:48.738390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f214efa4-cde2-4e91-931a-56cf0e382289 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:48.739151 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f214efa4-cde2-4e91-931a-56cf0e382289 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:48.749301 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f214efa4-cde2-4e91-931a-56cf0e382289 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:48.843434 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-7810ddcb-d9db-4d61-878b-4924b17d14e9 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:48.852128 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-7810ddcb-d9db-4d61-878b-4924b17d14e9 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1367 microversion: 2.1 time: 0.197039 Oct 26 11:18:48.852719 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 64/122] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:48 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:18:48.933054 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-f214efa4-cde2-4e91-931a-56cf0e382289 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:48.941153 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-f214efa4-cde2-4e91-931a-56cf0e382289 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1322 microversion: 2.1 time: 0.225551 Oct 26 11:18:48.942162 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 59/123] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:48 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:18:49.096070 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-30e7bba6-f5cf-481c-801b-7fac9f3061d6 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:49.096678 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-30e7bba6-f5cf-481c-801b-7fac9f3061d6 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:49.102494 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-30e7bba6-f5cf-481c-801b-7fac9f3061d6 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:49.103019 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-30e7bba6-f5cf-481c-801b-7fac9f3061d6 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:49.103452 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-30e7bba6-f5cf-481c-801b-7fac9f3061d6 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:49.104129 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-30e7bba6-f5cf-481c-801b-7fac9f3061d6 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:49.104722 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-30e7bba6-f5cf-481c-801b-7fac9f3061d6 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:49.105292 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-30e7bba6-f5cf-481c-801b-7fac9f3061d6 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:49.248694 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-30e7bba6-f5cf-481c-801b-7fac9f3061d6 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:49.256491 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-30e7bba6-f5cf-481c-801b-7fac9f3061d6 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1315 microversion: 2.1 time: 0.164258 Oct 26 11:18:49.257268 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 65/124] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:49 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:49.693343 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-4f6eb999-2a37-424a-87e9-597c9ce29d7a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:49.695062 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-4f6eb999-2a37-424a-87e9-597c9ce29d7a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:49.703143 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4f6eb999-2a37-424a-87e9-597c9ce29d7a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:49.703143 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4f6eb999-2a37-424a-87e9-597c9ce29d7a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:49.703143 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4f6eb999-2a37-424a-87e9-597c9ce29d7a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:49.703143 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4f6eb999-2a37-424a-87e9-597c9ce29d7a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:49.703560 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4f6eb999-2a37-424a-87e9-597c9ce29d7a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:49.704139 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4f6eb999-2a37-424a-87e9-597c9ce29d7a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:49.838082 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-4f6eb999-2a37-424a-87e9-597c9ce29d7a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:49.847258 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-4f6eb999-2a37-424a-87e9-597c9ce29d7a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:49.848715 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-4f6eb999-2a37-424a-87e9-597c9ce29d7a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:49.850096 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-4f6eb999-2a37-424a-87e9-597c9ce29d7a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1406 microversion: 2.20 time: 0.161275 Oct 26 11:18:49.850690 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 60/125] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:18:49 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:18:49.875434 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-bc63eab6-83b4-4ce8-b303-be61d70e7a72 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:49.876897 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-bc63eab6-83b4-4ce8-b303-be61d70e7a72 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:49.883773 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bc63eab6-83b4-4ce8-b303-be61d70e7a72 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:49.884483 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bc63eab6-83b4-4ce8-b303-be61d70e7a72 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:49.885043 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bc63eab6-83b4-4ce8-b303-be61d70e7a72 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:49.886487 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bc63eab6-83b4-4ce8-b303-be61d70e7a72 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:49.887697 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bc63eab6-83b4-4ce8-b303-be61d70e7a72 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:49.888216 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bc63eab6-83b4-4ce8-b303-be61d70e7a72 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:49.965777 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-2173b2b6-c418-45c9-8ed5-a07a723fb90a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:49.966316 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-2173b2b6-c418-45c9-8ed5-a07a723fb90a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:49.973214 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2173b2b6-c418-45c9-8ed5-a07a723fb90a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:49.973885 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2173b2b6-c418-45c9-8ed5-a07a723fb90a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:49.974467 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2173b2b6-c418-45c9-8ed5-a07a723fb90a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:49.975255 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2173b2b6-c418-45c9-8ed5-a07a723fb90a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:49.975767 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2173b2b6-c418-45c9-8ed5-a07a723fb90a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:49.976237 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2173b2b6-c418-45c9-8ed5-a07a723fb90a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:50.034166 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-bc63eab6-83b4-4ce8-b303-be61d70e7a72 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:50.042407 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-bc63eab6-83b4-4ce8-b303-be61d70e7a72 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1367 microversion: 2.1 time: 0.171354 Oct 26 11:18:50.044305 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 66/126] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:49 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:18:50.158313 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-2d0a0f37-eac2-4bb7-88af-06ca4ef408f4 req-552f0b69-f391-4ad9-a6ef-10e60bbddbd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f70dba-88ab-42ae-ace7-b95eeac5fcfc", "name": "network-vif-plugged", "status": "completed", "tag": "9710ecc2-ca47-4ec2-84c2-3aadb85ac335"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:18:50.169947 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-2d0a0f37-eac2-4bb7-88af-06ca4ef408f4 req-552f0b69-f391-4ad9-a6ef-10e60bbddbd7 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:50.170516 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-2d0a0f37-eac2-4bb7-88af-06ca4ef408f4 req-552f0b69-f391-4ad9-a6ef-10e60bbddbd7 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:50.170968 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-2d0a0f37-eac2-4bb7-88af-06ca4ef408f4 req-552f0b69-f391-4ad9-a6ef-10e60bbddbd7 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:50.187092 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-2d0a0f37-eac2-4bb7-88af-06ca4ef408f4 req-552f0b69-f391-4ad9-a6ef-10e60bbddbd7 service nova] Creating event network-vif-plugged:9710ecc2-ca47-4ec2-84c2-3aadb85ac335 for instance f2f70dba-88ab-42ae-ace7-b95eeac5fcfc on hv-cinder-81558 Oct 26 11:18:50.193779 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-2d0a0f37-eac2-4bb7-88af-06ca4ef408f4 req-552f0b69-f391-4ad9-a6ef-10e60bbddbd7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039834 Oct 26 11:18:50.194001 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-2173b2b6-c418-45c9-8ed5-a07a723fb90a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:50.194937 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 67/127] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:18:50.203754 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-2173b2b6-c418-45c9-8ed5-a07a723fb90a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1322 microversion: 2.1 time: 0.242432 Oct 26 11:18:50.204421 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 61/128] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:49 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:50.281582 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-419ef419-2673-48df-a4cf-b014c17b5730 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:50.282281 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-419ef419-2673-48df-a4cf-b014c17b5730 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:50.289225 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-419ef419-2673-48df-a4cf-b014c17b5730 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:50.289620 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-419ef419-2673-48df-a4cf-b014c17b5730 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:50.290273 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-419ef419-2673-48df-a4cf-b014c17b5730 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:50.291206 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-419ef419-2673-48df-a4cf-b014c17b5730 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:50.291658 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-419ef419-2673-48df-a4cf-b014c17b5730 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:50.292105 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-419ef419-2673-48df-a4cf-b014c17b5730 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:50.454621 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-419ef419-2673-48df-a4cf-b014c17b5730 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:50.463180 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-419ef419-2673-48df-a4cf-b014c17b5730 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1315 microversion: 2.1 time: 0.185829 Oct 26 11:18:50.463753 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 68/129] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:50 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:50.879026 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-24623c2e-70c2-4a28-aa2b-93c4c80259d1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:50.879676 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-24623c2e-70c2-4a28-aa2b-93c4c80259d1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:50.885543 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-24623c2e-70c2-4a28-aa2b-93c4c80259d1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:50.886046 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-24623c2e-70c2-4a28-aa2b-93c4c80259d1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:50.886482 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-24623c2e-70c2-4a28-aa2b-93c4c80259d1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:50.887193 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-24623c2e-70c2-4a28-aa2b-93c4c80259d1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:50.887827 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-24623c2e-70c2-4a28-aa2b-93c4c80259d1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:50.888247 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-24623c2e-70c2-4a28-aa2b-93c4c80259d1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:51.035450 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-24623c2e-70c2-4a28-aa2b-93c4c80259d1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:51.046338 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-24623c2e-70c2-4a28-aa2b-93c4c80259d1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:51.047968 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-24623c2e-70c2-4a28-aa2b-93c4c80259d1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:51.049246 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-24623c2e-70c2-4a28-aa2b-93c4c80259d1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1406 microversion: 2.20 time: 0.175667 Oct 26 11:18:51.066846 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 62/130] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:18:50 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:18:51.070059 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-65d226e9-edcf-4c16-8937-a512c5cde4cf tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:51.070669 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-65d226e9-edcf-4c16-8937-a512c5cde4cf tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:51.076756 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-65d226e9-edcf-4c16-8937-a512c5cde4cf tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:51.077237 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-65d226e9-edcf-4c16-8937-a512c5cde4cf tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:51.077673 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-65d226e9-edcf-4c16-8937-a512c5cde4cf tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:51.078356 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-65d226e9-edcf-4c16-8937-a512c5cde4cf tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:51.078802 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-65d226e9-edcf-4c16-8937-a512c5cde4cf tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:51.079238 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-65d226e9-edcf-4c16-8937-a512c5cde4cf tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:51.229148 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-65d226e9-edcf-4c16-8937-a512c5cde4cf tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:51.241313 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-1d2cd223-9f37-427e-b592-c663a7ac3f72 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:51.241677 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-65d226e9-edcf-4c16-8937-a512c5cde4cf tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1367 microversion: 2.1 time: 0.175773 Oct 26 11:18:51.242072 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-1d2cd223-9f37-427e-b592-c663a7ac3f72 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:51.242694 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 69/131] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:51 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:18:51.254952 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1d2cd223-9f37-427e-b592-c663a7ac3f72 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:51.255445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1d2cd223-9f37-427e-b592-c663a7ac3f72 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:51.255903 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1d2cd223-9f37-427e-b592-c663a7ac3f72 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:51.256789 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1d2cd223-9f37-427e-b592-c663a7ac3f72 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:51.257545 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1d2cd223-9f37-427e-b592-c663a7ac3f72 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:51.264140 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1d2cd223-9f37-427e-b592-c663a7ac3f72 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:51.437716 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-1d2cd223-9f37-427e-b592-c663a7ac3f72 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:51.447297 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-1d2cd223-9f37-427e-b592-c663a7ac3f72 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1322 microversion: 2.1 time: 0.214820 Oct 26 11:18:51.463208 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 63/132] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:51 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:51.488699 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-02cae2b5-7432-441f-8d40-9a93a06a8209 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:51.489376 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-02cae2b5-7432-441f-8d40-9a93a06a8209 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:51.495500 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-02cae2b5-7432-441f-8d40-9a93a06a8209 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:51.496062 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-02cae2b5-7432-441f-8d40-9a93a06a8209 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:51.496546 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-02cae2b5-7432-441f-8d40-9a93a06a8209 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:51.497298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-02cae2b5-7432-441f-8d40-9a93a06a8209 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:51.497812 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-02cae2b5-7432-441f-8d40-9a93a06a8209 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:51.498309 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-02cae2b5-7432-441f-8d40-9a93a06a8209 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:51.633216 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-02cae2b5-7432-441f-8d40-9a93a06a8209 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:51.637899 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=100 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:51.642513 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-02cae2b5-7432-441f-8d40-9a93a06a8209 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1315 microversion: 2.1 time: 0.157869 Oct 26 11:18:51.643128 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 70/133] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:51 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:52.075832 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-6f8f8659-ad44-4bc3-b9da-eef9db90bcb3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:52.079640 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-6f8f8659-ad44-4bc3-b9da-eef9db90bcb3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:52.087323 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6f8f8659-ad44-4bc3-b9da-eef9db90bcb3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:52.088129 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6f8f8659-ad44-4bc3-b9da-eef9db90bcb3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:52.088872 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6f8f8659-ad44-4bc3-b9da-eef9db90bcb3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:52.089822 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6f8f8659-ad44-4bc3-b9da-eef9db90bcb3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:52.090711 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6f8f8659-ad44-4bc3-b9da-eef9db90bcb3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:52.092454 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6f8f8659-ad44-4bc3-b9da-eef9db90bcb3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:52.252146 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-6f8f8659-ad44-4bc3-b9da-eef9db90bcb3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:52.260464 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-6f8f8659-ad44-4bc3-b9da-eef9db90bcb3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:52.262036 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-6f8f8659-ad44-4bc3-b9da-eef9db90bcb3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:52.263179 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-6f8f8659-ad44-4bc3-b9da-eef9db90bcb3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1406 microversion: 2.20 time: 0.193571 Oct 26 11:18:52.263996 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 64/134] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:18:52 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:18:52.266053 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e697e37a-3689-4e74-bb42-35311083d883 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:52.266053 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-e697e37a-3689-4e74-bb42-35311083d883 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:52.271735 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e697e37a-3689-4e74-bb42-35311083d883 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:52.272235 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e697e37a-3689-4e74-bb42-35311083d883 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:52.272671 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e697e37a-3689-4e74-bb42-35311083d883 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:52.273366 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e697e37a-3689-4e74-bb42-35311083d883 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:52.273816 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e697e37a-3689-4e74-bb42-35311083d883 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:52.274230 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e697e37a-3689-4e74-bb42-35311083d883 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:52.470374 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-7701cb83-2d3a-4234-887d-d9be6c4fda19 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:52.471060 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-7701cb83-2d3a-4234-887d-d9be6c4fda19 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:52.481639 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7701cb83-2d3a-4234-887d-d9be6c4fda19 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:52.482141 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7701cb83-2d3a-4234-887d-d9be6c4fda19 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:52.487036 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7701cb83-2d3a-4234-887d-d9be6c4fda19 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:52.487863 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7701cb83-2d3a-4234-887d-d9be6c4fda19 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:52.488517 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7701cb83-2d3a-4234-887d-d9be6c4fda19 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:52.489103 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7701cb83-2d3a-4234-887d-d9be6c4fda19 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:52.538864 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-e697e37a-3689-4e74-bb42-35311083d883 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:52.559389 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-e697e37a-3689-4e74-bb42-35311083d883 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1367 microversion: 2.1 time: 0.296942 Oct 26 11:18:52.561402 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 71/135] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:52 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:18:52.666245 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-7ac14069-3609-4c5c-89e2-37ff4a6b849d tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:52.667140 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-7ac14069-3609-4c5c-89e2-37ff4a6b849d tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:52.675137 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7ac14069-3609-4c5c-89e2-37ff4a6b849d tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:52.684776 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7ac14069-3609-4c5c-89e2-37ff4a6b849d tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:52.684776 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7ac14069-3609-4c5c-89e2-37ff4a6b849d tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:52.684776 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7ac14069-3609-4c5c-89e2-37ff4a6b849d tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:52.684776 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7ac14069-3609-4c5c-89e2-37ff4a6b849d tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:52.685229 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7ac14069-3609-4c5c-89e2-37ff4a6b849d tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:52.686861 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-7701cb83-2d3a-4234-887d-d9be6c4fda19 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:52.696749 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-7701cb83-2d3a-4234-887d-d9be6c4fda19 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1322 microversion: 2.1 time: 0.230526 Oct 26 11:18:52.697779 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 65/136] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:52 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:52.852489 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-7ac14069-3609-4c5c-89e2-37ff4a6b849d tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:52.861722 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-7ac14069-3609-4c5c-89e2-37ff4a6b849d tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1501 microversion: 2.1 time: 0.199933 Oct 26 11:18:52.862314 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 72/137] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:52 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1501 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:18:53.290753 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-9cf53a29-53f9-4baf-a701-d34aea4fe137 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:53.291390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-9cf53a29-53f9-4baf-a701-d34aea4fe137 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:53.297521 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9cf53a29-53f9-4baf-a701-d34aea4fe137 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:53.297941 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9cf53a29-53f9-4baf-a701-d34aea4fe137 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:53.298768 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9cf53a29-53f9-4baf-a701-d34aea4fe137 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:53.299469 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9cf53a29-53f9-4baf-a701-d34aea4fe137 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:53.299914 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9cf53a29-53f9-4baf-a701-d34aea4fe137 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:53.300327 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9cf53a29-53f9-4baf-a701-d34aea4fe137 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:53.431038 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-9cf53a29-53f9-4baf-a701-d34aea4fe137 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:53.439510 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-9cf53a29-53f9-4baf-a701-d34aea4fe137 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:53.440916 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-9cf53a29-53f9-4baf-a701-d34aea4fe137 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:53.442002 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-9cf53a29-53f9-4baf-a701-d34aea4fe137 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1406 microversion: 2.20 time: 0.155602 Oct 26 11:18:53.442554 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 66/138] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:18:53 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:18:53.585806 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-d2a0f8aa-b03c-4c69-9df2-7dcd6d5b4c74 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:53.586442 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-d2a0f8aa-b03c-4c69-9df2-7dcd6d5b4c74 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:53.592622 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d2a0f8aa-b03c-4c69-9df2-7dcd6d5b4c74 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:53.593112 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d2a0f8aa-b03c-4c69-9df2-7dcd6d5b4c74 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:53.593555 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d2a0f8aa-b03c-4c69-9df2-7dcd6d5b4c74 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:53.594254 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d2a0f8aa-b03c-4c69-9df2-7dcd6d5b4c74 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:53.594708 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d2a0f8aa-b03c-4c69-9df2-7dcd6d5b4c74 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:53.595156 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d2a0f8aa-b03c-4c69-9df2-7dcd6d5b4c74 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:53.720505 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-18567aea-12d7-4b59-bcc9-a6212e2b00b4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:53.721343 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-18567aea-12d7-4b59-bcc9-a6212e2b00b4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:53.729776 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-18567aea-12d7-4b59-bcc9-a6212e2b00b4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:53.730798 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-18567aea-12d7-4b59-bcc9-a6212e2b00b4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:53.731283 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-18567aea-12d7-4b59-bcc9-a6212e2b00b4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:53.731987 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-18567aea-12d7-4b59-bcc9-a6212e2b00b4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:53.732445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-18567aea-12d7-4b59-bcc9-a6212e2b00b4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:53.732869 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-18567aea-12d7-4b59-bcc9-a6212e2b00b4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:53.813664 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-d2a0f8aa-b03c-4c69-9df2-7dcd6d5b4c74 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:53.824544 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-d2a0f8aa-b03c-4c69-9df2-7dcd6d5b4c74 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1367 microversion: 2.1 time: 0.241269 Oct 26 11:18:53.825219 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 73/139] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:53 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:53.991949 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-18567aea-12d7-4b59-bcc9-a6212e2b00b4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:53.995704 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=100 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:54.019060 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-18567aea-12d7-4b59-bcc9-a6212e2b00b4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1322 microversion: 2.1 time: 0.302228 Oct 26 11:18:54.020039 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 67/140] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:53 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:18:54.182935 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-8aff2b66-d9a1-410b-804b-492c4bbb3975 req-8c875697-f119-4be7-b246-160a1edf694a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c038aa8-5351-4f13-8fc5-32674a0f6dce", "name": "network-vif-plugged", "status": "completed", "tag": "caf5feb7-a01a-4f65-a03c-f3013b3ab59d"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:18:54.193087 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-8aff2b66-d9a1-410b-804b-492c4bbb3975 req-8c875697-f119-4be7-b246-160a1edf694a service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:54.193555 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-8aff2b66-d9a1-410b-804b-492c4bbb3975 req-8c875697-f119-4be7-b246-160a1edf694a service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:54.194140 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-8aff2b66-d9a1-410b-804b-492c4bbb3975 req-8c875697-f119-4be7-b246-160a1edf694a service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:54.205860 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-8aff2b66-d9a1-410b-804b-492c4bbb3975 req-8c875697-f119-4be7-b246-160a1edf694a service nova] Creating event network-vif-plugged:caf5feb7-a01a-4f65-a03c-f3013b3ab59d for instance 5c038aa8-5351-4f13-8fc5-32674a0f6dce on hv-cinder-81558 Oct 26 11:18:54.210980 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-8aff2b66-d9a1-410b-804b-492c4bbb3975 req-8c875697-f119-4be7-b246-160a1edf694a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031948 Oct 26 11:18:54.211575 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 74/141] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:18:54.466738 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-722eb21b-88ae-4e06-b8c1-4a6d2647f256 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:54.467376 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-722eb21b-88ae-4e06-b8c1-4a6d2647f256 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:54.473241 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-722eb21b-88ae-4e06-b8c1-4a6d2647f256 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:54.473715 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-722eb21b-88ae-4e06-b8c1-4a6d2647f256 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:54.474143 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-722eb21b-88ae-4e06-b8c1-4a6d2647f256 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:54.474835 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-722eb21b-88ae-4e06-b8c1-4a6d2647f256 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:54.475284 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-722eb21b-88ae-4e06-b8c1-4a6d2647f256 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:54.475700 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-722eb21b-88ae-4e06-b8c1-4a6d2647f256 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:54.609748 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-722eb21b-88ae-4e06-b8c1-4a6d2647f256 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:54.618371 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-722eb21b-88ae-4e06-b8c1-4a6d2647f256 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:54.620187 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-722eb21b-88ae-4e06-b8c1-4a6d2647f256 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:54.621376 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-722eb21b-88ae-4e06-b8c1-4a6d2647f256 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1599 microversion: 2.20 time: 0.158580 Oct 26 11:18:54.634017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 68/142] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:18:54 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:18:54.648668 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-8ac17d3f-25b2-4001-a322-7726ee04742a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:54.649246 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-8ac17d3f-25b2-4001-a322-7726ee04742a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:54.659281 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8ac17d3f-25b2-4001-a322-7726ee04742a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:54.659281 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8ac17d3f-25b2-4001-a322-7726ee04742a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:54.659281 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8ac17d3f-25b2-4001-a322-7726ee04742a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:54.659281 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8ac17d3f-25b2-4001-a322-7726ee04742a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:54.659740 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8ac17d3f-25b2-4001-a322-7726ee04742a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:54.659740 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8ac17d3f-25b2-4001-a322-7726ee04742a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:54.786206 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-8ac17d3f-25b2-4001-a322-7726ee04742a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.141930 Oct 26 11:18:54.786880 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 75/143] 10.222.0.42 () {60 vars in 1316 bytes} [Wed Oct 26 11:18:54 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a/os-interface => generated 285 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 11:18:54.847748 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-73d00186-5ef8-4632-8557-0637212b7ec7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:54.848484 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-73d00186-5ef8-4632-8557-0637212b7ec7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:54.855170 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-73d00186-5ef8-4632-8557-0637212b7ec7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:54.856489 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-73d00186-5ef8-4632-8557-0637212b7ec7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:54.857271 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-73d00186-5ef8-4632-8557-0637212b7ec7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:54.858127 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-73d00186-5ef8-4632-8557-0637212b7ec7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:54.858783 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-73d00186-5ef8-4632-8557-0637212b7ec7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:54.863729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-73d00186-5ef8-4632-8557-0637212b7ec7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:54.997129 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-73d00186-5ef8-4632-8557-0637212b7ec7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:55.013824 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-73d00186-5ef8-4632-8557-0637212b7ec7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1367 microversion: 2.1 time: 0.169727 Oct 26 11:18:55.015560 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 69/144] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:54 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:18:55.041434 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-b20f1f28-851f-44d7-9789-8cb3f957f43c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:55.042050 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-b20f1f28-851f-44d7-9789-8cb3f957f43c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:55.048395 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b20f1f28-851f-44d7-9789-8cb3f957f43c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:55.049702 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b20f1f28-851f-44d7-9789-8cb3f957f43c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:55.049702 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b20f1f28-851f-44d7-9789-8cb3f957f43c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:55.050077 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b20f1f28-851f-44d7-9789-8cb3f957f43c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:55.050720 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b20f1f28-851f-44d7-9789-8cb3f957f43c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:55.051176 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b20f1f28-851f-44d7-9789-8cb3f957f43c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:55.375958 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-b20f1f28-851f-44d7-9789-8cb3f957f43c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:55.384057 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-b20f1f28-851f-44d7-9789-8cb3f957f43c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1322 microversion: 2.1 time: 0.346456 Oct 26 11:18:55.385807 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 76/145] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:55 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1322 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:56.037743 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-95930f3d-dfe7-4790-a2c8-8718ab601b43 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:56.039255 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-95930f3d-dfe7-4790-a2c8-8718ab601b43 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:56.046583 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-95930f3d-dfe7-4790-a2c8-8718ab601b43 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:56.047292 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-95930f3d-dfe7-4790-a2c8-8718ab601b43 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:56.047876 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-95930f3d-dfe7-4790-a2c8-8718ab601b43 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:56.048727 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-95930f3d-dfe7-4790-a2c8-8718ab601b43 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:56.049328 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-95930f3d-dfe7-4790-a2c8-8718ab601b43 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:56.049895 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-95930f3d-dfe7-4790-a2c8-8718ab601b43 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:56.209621 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-95930f3d-dfe7-4790-a2c8-8718ab601b43 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:56.219673 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-95930f3d-dfe7-4790-a2c8-8718ab601b43 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1367 microversion: 2.1 time: 0.185406 Oct 26 11:18:56.220730 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 70/146] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:56 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:56.410334 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-2775b84d-bc6a-4bda-9787-5a112756a0a3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:56.411837 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-2775b84d-bc6a-4bda-9787-5a112756a0a3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:56.420574 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2775b84d-bc6a-4bda-9787-5a112756a0a3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:56.421398 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2775b84d-bc6a-4bda-9787-5a112756a0a3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:56.421844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2775b84d-bc6a-4bda-9787-5a112756a0a3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:56.422667 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2775b84d-bc6a-4bda-9787-5a112756a0a3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:56.423583 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2775b84d-bc6a-4bda-9787-5a112756a0a3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:56.424627 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2775b84d-bc6a-4bda-9787-5a112756a0a3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:56.542140 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a9b5678b-e32a-43ea-ae14-640f3b327d50 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "994101fe-6475-41fc-ab49-aa33066488ad"}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:18:56.544917 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-a9b5678b-e32a-43ea-ae14-640f3b327d50 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:56.564089 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a9b5678b-e32a-43ea-ae14-640f3b327d50 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:56.564622 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a9b5678b-e32a-43ea-ae14-640f3b327d50 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:56.565065 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a9b5678b-e32a-43ea-ae14-640f3b327d50 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:56.566677 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a9b5678b-e32a-43ea-ae14-640f3b327d50 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:56.566677 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a9b5678b-e32a-43ea-ae14-640f3b327d50 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:56.575708 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a9b5678b-e32a-43ea-ae14-640f3b327d50 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:56.785995 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-2775b84d-bc6a-4bda-9787-5a112756a0a3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:56.796441 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-2775b84d-bc6a-4bda-9787-5a112756a0a3 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1322 microversion: 2.1 time: 0.390526 Oct 26 11:18:56.811809 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 77/147] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:56 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1322 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:56.819248 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-3fabbcd7-5ae4-447e-af7e-d15416f59a31 req-d539a81b-6a94-4e2b-aa24-4932d2a63f56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2821a8ff-1cb6-43c5-9968-1c13e293ad1a", "tag": "6cd2d732-48e8-4aca-ac57-8f769619a1f1"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:18:56.833651 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-3fabbcd7-5ae4-447e-af7e-d15416f59a31 req-d539a81b-6a94-4e2b-aa24-4932d2a63f56 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:56.834386 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-3fabbcd7-5ae4-447e-af7e-d15416f59a31 req-d539a81b-6a94-4e2b-aa24-4932d2a63f56 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:56.835007 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-3fabbcd7-5ae4-447e-af7e-d15416f59a31 req-d539a81b-6a94-4e2b-aa24-4932d2a63f56 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:56.848668 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-3fabbcd7-5ae4-447e-af7e-d15416f59a31 req-d539a81b-6a94-4e2b-aa24-4932d2a63f56 service nova] Creating event network-changed:6cd2d732-48e8-4aca-ac57-8f769619a1f1 for instance 2821a8ff-1cb6-43c5-9968-1c13e293ad1a on hv-cinder-81558 Oct 26 11:18:56.856340 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-3fabbcd7-5ae4-447e-af7e-d15416f59a31 req-d539a81b-6a94-4e2b-aa24-4932d2a63f56 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042977 Oct 26 11:18:56.861584 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 78/148] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:18:57.247774 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-f5969d8d-9497-4645-876f-9497fb738d26 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:57.248714 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-f5969d8d-9497-4645-876f-9497fb738d26 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:57.255993 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f5969d8d-9497-4645-876f-9497fb738d26 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:57.256490 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f5969d8d-9497-4645-876f-9497fb738d26 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:57.263281 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f5969d8d-9497-4645-876f-9497fb738d26 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:57.263281 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f5969d8d-9497-4645-876f-9497fb738d26 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:57.263281 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f5969d8d-9497-4645-876f-9497fb738d26 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:57.263281 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f5969d8d-9497-4645-876f-9497fb738d26 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:57.422400 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-f5969d8d-9497-4645-876f-9497fb738d26 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:57.437695 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-f5969d8d-9497-4645-876f-9497fb738d26 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1367 microversion: 2.1 time: 0.196359 Oct 26 11:18:57.438998 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 79/149] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:57 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:18:57.832908 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-dbf1ae74-1133-499e-aa66-60176370733a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:57.833964 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-dbf1ae74-1133-499e-aa66-60176370733a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:57.841401 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dbf1ae74-1133-499e-aa66-60176370733a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:57.842352 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dbf1ae74-1133-499e-aa66-60176370733a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:57.843631 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dbf1ae74-1133-499e-aa66-60176370733a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:57.844666 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dbf1ae74-1133-499e-aa66-60176370733a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:57.845577 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dbf1ae74-1133-499e-aa66-60176370733a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:57.846224 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dbf1ae74-1133-499e-aa66-60176370733a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:58.011574 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-dbf1ae74-1133-499e-aa66-60176370733a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:58.018934 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-dbf1ae74-1133-499e-aa66-60176370733a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1322 microversion: 2.1 time: 0.194830 Oct 26 11:18:58.019506 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 80/150] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:57 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:58.465582 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-32f703a9-8d1e-45c8-bb36-5c0e91742580 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:58.466564 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-32f703a9-8d1e-45c8-bb36-5c0e91742580 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:58.473982 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=100 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:18:58.475520 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-32f703a9-8d1e-45c8-bb36-5c0e91742580 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:58.476114 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-32f703a9-8d1e-45c8-bb36-5c0e91742580 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:58.476632 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-32f703a9-8d1e-45c8-bb36-5c0e91742580 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:58.477483 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-32f703a9-8d1e-45c8-bb36-5c0e91742580 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:58.478128 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-32f703a9-8d1e-45c8-bb36-5c0e91742580 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:58.478604 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-32f703a9-8d1e-45c8-bb36-5c0e91742580 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:58.620564 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-32f703a9-8d1e-45c8-bb36-5c0e91742580 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:58.631961 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-32f703a9-8d1e-45c8-bb36-5c0e91742580 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1367 microversion: 2.1 time: 0.168660 Oct 26 11:18:58.649061 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 81/151] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:58 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:58.943306 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-a9b5678b-e32a-43ea-ae14-640f3b327d50 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "POST /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.402897 Oct 26 11:18:58.943306 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 71/152] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Oct 26 11:18:56 2022] POST /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be/os-volume_attachments => generated 194 bytes in 2405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:18:59.046600 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-7362e87c-cfb1-4f51-ba73-ff34dc876280 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:59.047244 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-7362e87c-cfb1-4f51-ba73-ff34dc876280 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:59.053603 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7362e87c-cfb1-4f51-ba73-ff34dc876280 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:59.054098 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7362e87c-cfb1-4f51-ba73-ff34dc876280 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:59.054534 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7362e87c-cfb1-4f51-ba73-ff34dc876280 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:59.055258 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7362e87c-cfb1-4f51-ba73-ff34dc876280 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:59.055872 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7362e87c-cfb1-4f51-ba73-ff34dc876280 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:59.056294 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7362e87c-cfb1-4f51-ba73-ff34dc876280 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:59.200122 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-7362e87c-cfb1-4f51-ba73-ff34dc876280 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:59.210379 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-7362e87c-cfb1-4f51-ba73-ff34dc876280 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1322 microversion: 2.1 time: 0.168240 Oct 26 11:18:59.211091 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 82/153] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:59 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:18:59.657799 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-e581505f-b9a6-4fe3-aaf3-5c0bfa742783 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:18:59.658501 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-e581505f-b9a6-4fe3-aaf3-5c0bfa742783 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:18:59.666440 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e581505f-b9a6-4fe3-aaf3-5c0bfa742783 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:59.666958 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e581505f-b9a6-4fe3-aaf3-5c0bfa742783 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:59.667397 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e581505f-b9a6-4fe3-aaf3-5c0bfa742783 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:59.668124 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e581505f-b9a6-4fe3-aaf3-5c0bfa742783 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:18:59.668531 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e581505f-b9a6-4fe3-aaf3-5c0bfa742783 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:18:59.669485 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e581505f-b9a6-4fe3-aaf3-5c0bfa742783 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:18:59.846849 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-e581505f-b9a6-4fe3-aaf3-5c0bfa742783 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:18:59.854867 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-e581505f-b9a6-4fe3-aaf3-5c0bfa742783 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1367 microversion: 2.1 time: 0.201839 Oct 26 11:18:59.855446 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 72/154] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:18:59 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:00.234565 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-f597c261-05ec-49a9-bb36-3277041ce858 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:00.235806 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-f597c261-05ec-49a9-bb36-3277041ce858 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:00.242214 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f597c261-05ec-49a9-bb36-3277041ce858 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:00.242758 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f597c261-05ec-49a9-bb36-3277041ce858 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:00.248668 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f597c261-05ec-49a9-bb36-3277041ce858 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:00.248668 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f597c261-05ec-49a9-bb36-3277041ce858 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:00.248668 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f597c261-05ec-49a9-bb36-3277041ce858 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:00.248668 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f597c261-05ec-49a9-bb36-3277041ce858 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:00.318971 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-898334cc-2f08-4997-a919-21a0509653ff req-66c7c200-72a6-435f-b687-7123717ed8c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3d343d6-fcf5-4a1b-a077-d2e28d613a70", "name": "network-vif-plugged", "status": "completed", "tag": "0bd9ab45-c3f2-4623-8bcc-0d43ada4210e"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:19:00.339704 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-898334cc-2f08-4997-a919-21a0509653ff req-66c7c200-72a6-435f-b687-7123717ed8c0 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:00.342177 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-898334cc-2f08-4997-a919-21a0509653ff req-66c7c200-72a6-435f-b687-7123717ed8c0 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:00.342806 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-898334cc-2f08-4997-a919-21a0509653ff req-66c7c200-72a6-435f-b687-7123717ed8c0 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:00.354203 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-898334cc-2f08-4997-a919-21a0509653ff req-66c7c200-72a6-435f-b687-7123717ed8c0 service nova] Creating event network-vif-plugged:0bd9ab45-c3f2-4623-8bcc-0d43ada4210e for instance f3d343d6-fcf5-4a1b-a077-d2e28d613a70 on hv-cinder-81558 Oct 26 11:19:00.359776 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-898334cc-2f08-4997-a919-21a0509653ff req-66c7c200-72a6-435f-b687-7123717ed8c0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048472 Oct 26 11:19:00.360382 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 73/155] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:19:00.398426 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-f597c261-05ec-49a9-bb36-3277041ce858 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:00.406807 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-f597c261-05ec-49a9-bb36-3277041ce858 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1322 microversion: 2.1 time: 0.177200 Oct 26 11:19:00.407391 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 83/156] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:00 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:19:00.892636 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-3872cd05-cff1-4cdb-ae64-9b30f464e9db tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:00.893372 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-3872cd05-cff1-4cdb-ae64-9b30f464e9db tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:00.900878 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3872cd05-cff1-4cdb-ae64-9b30f464e9db tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:00.901431 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3872cd05-cff1-4cdb-ae64-9b30f464e9db tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:00.901865 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3872cd05-cff1-4cdb-ae64-9b30f464e9db tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:00.902778 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3872cd05-cff1-4cdb-ae64-9b30f464e9db tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:00.903670 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3872cd05-cff1-4cdb-ae64-9b30f464e9db tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:00.904248 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3872cd05-cff1-4cdb-ae64-9b30f464e9db tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:01.086907 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-3872cd05-cff1-4cdb-ae64-9b30f464e9db tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:01.111398 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-3872cd05-cff1-4cdb-ae64-9b30f464e9db tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1558 microversion: 2.1 time: 0.221913 Oct 26 11:19:01.111398 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 74/157] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:00 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:01.128980 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-7dfdb186-ce3a-435c-8996-1dec5f001c26 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:01.129408 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-7dfdb186-ce3a-435c-8996-1dec5f001c26 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:01.141422 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7dfdb186-ce3a-435c-8996-1dec5f001c26 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:01.142154 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7dfdb186-ce3a-435c-8996-1dec5f001c26 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:01.142786 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7dfdb186-ce3a-435c-8996-1dec5f001c26 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:01.143976 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7dfdb186-ce3a-435c-8996-1dec5f001c26 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:01.158859 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7dfdb186-ce3a-435c-8996-1dec5f001c26 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:01.162046 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7dfdb186-ce3a-435c-8996-1dec5f001c26 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:01.283811 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-7dfdb186-ce3a-435c-8996-1dec5f001c26 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.159337 Oct 26 11:19:01.284442 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 84/158] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Oct 26 11:19:01 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce/os-interface => generated 285 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:19:01.432754 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-411870d2-ff48-4079-8a56-d27a52d1b6de tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:01.434314 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-411870d2-ff48-4079-8a56-d27a52d1b6de tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:01.443366 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-411870d2-ff48-4079-8a56-d27a52d1b6de tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:01.444454 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-411870d2-ff48-4079-8a56-d27a52d1b6de tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:01.446015 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-411870d2-ff48-4079-8a56-d27a52d1b6de tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:01.446763 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-411870d2-ff48-4079-8a56-d27a52d1b6de tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:01.448086 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-411870d2-ff48-4079-8a56-d27a52d1b6de tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:01.448662 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-411870d2-ff48-4079-8a56-d27a52d1b6de tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:01.678569 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-411870d2-ff48-4079-8a56-d27a52d1b6de tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:01.687321 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-411870d2-ff48-4079-8a56-d27a52d1b6de tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1322 microversion: 2.1 time: 0.260840 Oct 26 11:19:01.687863 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 75/159] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:01 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:02.714075 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-ea773a23-0c07-4d23-b66a-dd504a518a8a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:02.715242 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-ea773a23-0c07-4d23-b66a-dd504a518a8a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:02.729889 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ea773a23-0c07-4d23-b66a-dd504a518a8a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:02.730654 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ea773a23-0c07-4d23-b66a-dd504a518a8a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:02.739379 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ea773a23-0c07-4d23-b66a-dd504a518a8a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:02.754987 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ea773a23-0c07-4d23-b66a-dd504a518a8a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:02.757460 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ea773a23-0c07-4d23-b66a-dd504a518a8a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:02.758127 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ea773a23-0c07-4d23-b66a-dd504a518a8a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:02.898214 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-8b0e0064-7b0d-4c4a-949a-21e5f9ff9f76 req-7850706f-4716-47b8-b0a3-343a75d4cb01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c038aa8-5351-4f13-8fc5-32674a0f6dce", "tag": "caf5feb7-a01a-4f65-a03c-f3013b3ab59d"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:19:02.910018 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-8b0e0064-7b0d-4c4a-949a-21e5f9ff9f76 req-7850706f-4716-47b8-b0a3-343a75d4cb01 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:02.910729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-8b0e0064-7b0d-4c4a-949a-21e5f9ff9f76 req-7850706f-4716-47b8-b0a3-343a75d4cb01 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:02.911188 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-8b0e0064-7b0d-4c4a-949a-21e5f9ff9f76 req-7850706f-4716-47b8-b0a3-343a75d4cb01 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:02.923147 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-8b0e0064-7b0d-4c4a-949a-21e5f9ff9f76 req-7850706f-4716-47b8-b0a3-343a75d4cb01 service nova] Creating event network-changed:caf5feb7-a01a-4f65-a03c-f3013b3ab59d for instance 5c038aa8-5351-4f13-8fc5-32674a0f6dce on hv-cinder-81558 Oct 26 11:19:02.929098 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-8b0e0064-7b0d-4c4a-949a-21e5f9ff9f76 req-7850706f-4716-47b8-b0a3-343a75d4cb01 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035102 Oct 26 11:19:02.929596 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 76/160] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:19:03.025945 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ea773a23-0c07-4d23-b66a-dd504a518a8a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:03.036013 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-ea773a23-0c07-4d23-b66a-dd504a518a8a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1322 microversion: 2.1 time: 0.327948 Oct 26 11:19:03.037010 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 85/161] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:02 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1322 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:04.061930 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a8b91a28-e219-4b07-9d2d-a1ff2a745157 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:04.062900 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-a8b91a28-e219-4b07-9d2d-a1ff2a745157 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:04.083221 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a8b91a28-e219-4b07-9d2d-a1ff2a745157 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:04.083835 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a8b91a28-e219-4b07-9d2d-a1ff2a745157 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:04.086352 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a8b91a28-e219-4b07-9d2d-a1ff2a745157 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:04.087409 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a8b91a28-e219-4b07-9d2d-a1ff2a745157 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:04.090128 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a8b91a28-e219-4b07-9d2d-a1ff2a745157 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:04.090856 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a8b91a28-e219-4b07-9d2d-a1ff2a745157 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:04.649412 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-a8b91a28-e219-4b07-9d2d-a1ff2a745157 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:04.658312 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-a8b91a28-e219-4b07-9d2d-a1ff2a745157 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1516 microversion: 2.1 time: 0.601308 Oct 26 11:19:04.658925 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 77/162] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:04 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1516 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:04.682724 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-61a1b069-168d-446c-92f4-006716e0c10b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:19:04.686943 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-61a1b069-168d-446c-92f4-006716e0c10b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:04.694543 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-61a1b069-168d-446c-92f4-006716e0c10b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:04.695224 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-61a1b069-168d-446c-92f4-006716e0c10b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:04.698083 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-61a1b069-168d-446c-92f4-006716e0c10b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:04.698083 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-61a1b069-168d-446c-92f4-006716e0c10b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:04.698448 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-61a1b069-168d-446c-92f4-006716e0c10b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:04.699059 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-61a1b069-168d-446c-92f4-006716e0c10b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:04.734027 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.objects.instance [None req-61a1b069-168d-446c-92f4-006716e0c10b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lazy-loading 'flavor' on Instance uuid f3d343d6-fcf5-4a1b-a077-d2e28d613a70 {{(pid=119306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:19:05.119487 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-61a1b069-168d-446c-92f4-006716e0c10b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "POST /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70/action" status: 200 len: 32 microversion: 2.1 time: 0.440638 Oct 26 11:19:05.120103 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 86/163] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Oct 26 11:19:04 2022] POST /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70/action => generated 32 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 11:19:05.130019 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-d71a4cdb-d46e-4932-9d5a-d7160d6a9fd4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:05.130625 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-d71a4cdb-d46e-4932-9d5a-d7160d6a9fd4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:05.137159 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d71a4cdb-d46e-4932-9d5a-d7160d6a9fd4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:05.137639 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d71a4cdb-d46e-4932-9d5a-d7160d6a9fd4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:05.138102 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d71a4cdb-d46e-4932-9d5a-d7160d6a9fd4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:05.139372 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d71a4cdb-d46e-4932-9d5a-d7160d6a9fd4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:05.139821 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d71a4cdb-d46e-4932-9d5a-d7160d6a9fd4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:05.140240 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d71a4cdb-d46e-4932-9d5a-d7160d6a9fd4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:05.275266 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-d71a4cdb-d46e-4932-9d5a-d7160d6a9fd4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:05.295425 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-d71a4cdb-d46e-4932-9d5a-d7160d6a9fd4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.160843 Oct 26 11:19:05.295425 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 78/164] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:05 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:06.317744 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-20968378-446b-4002-b2ed-52205b3248c2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:06.318852 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-20968378-446b-4002-b2ed-52205b3248c2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:06.325923 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-20968378-446b-4002-b2ed-52205b3248c2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:06.327082 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-20968378-446b-4002-b2ed-52205b3248c2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:06.327595 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-20968378-446b-4002-b2ed-52205b3248c2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:06.328366 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-20968378-446b-4002-b2ed-52205b3248c2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:06.328994 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-20968378-446b-4002-b2ed-52205b3248c2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:06.329499 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-20968378-446b-4002-b2ed-52205b3248c2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:06.350082 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:19:06.485230 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-20968378-446b-4002-b2ed-52205b3248c2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:06.493317 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-20968378-446b-4002-b2ed-52205b3248c2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.179805 Oct 26 11:19:06.499250 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 87/165] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:06 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:07.518498 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-6a7c9675-236d-4b5d-88fd-2d500eeecf97 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:07.519747 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-6a7c9675-236d-4b5d-88fd-2d500eeecf97 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:07.523381 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_api:SELECT=91 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:19:07.527811 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6a7c9675-236d-4b5d-88fd-2d500eeecf97 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:07.528540 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6a7c9675-236d-4b5d-88fd-2d500eeecf97 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:07.529192 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6a7c9675-236d-4b5d-88fd-2d500eeecf97 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:07.529924 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6a7c9675-236d-4b5d-88fd-2d500eeecf97 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:07.530563 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6a7c9675-236d-4b5d-88fd-2d500eeecf97 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:07.531380 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6a7c9675-236d-4b5d-88fd-2d500eeecf97 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:07.764566 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-6a7c9675-236d-4b5d-88fd-2d500eeecf97 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:07.772484 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-6a7c9675-236d-4b5d-88fd-2d500eeecf97 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.258800 Oct 26 11:19:07.773080 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 79/166] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:07 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:08.796460 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-3072b261-c217-4770-864b-2206150cc198 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:08.797365 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-3072b261-c217-4770-864b-2206150cc198 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:08.804026 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3072b261-c217-4770-864b-2206150cc198 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:08.804525 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3072b261-c217-4770-864b-2206150cc198 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:08.805260 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3072b261-c217-4770-864b-2206150cc198 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:08.805966 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3072b261-c217-4770-864b-2206150cc198 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:08.806416 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3072b261-c217-4770-864b-2206150cc198 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:08.806850 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3072b261-c217-4770-864b-2206150cc198 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:08.946347 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-3072b261-c217-4770-864b-2206150cc198 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:08.954429 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-3072b261-c217-4770-864b-2206150cc198 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.162532 Oct 26 11:19:08.955028 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 88/167] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:08 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:19:09.977430 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-de87fddf-d2d2-4316-a3c7-3bc21d2e1e8d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:09.978109 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-de87fddf-d2d2-4316-a3c7-3bc21d2e1e8d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:09.984917 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-de87fddf-d2d2-4316-a3c7-3bc21d2e1e8d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:09.985429 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-de87fddf-d2d2-4316-a3c7-3bc21d2e1e8d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:09.986149 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-de87fddf-d2d2-4316-a3c7-3bc21d2e1e8d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:09.986861 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-de87fddf-d2d2-4316-a3c7-3bc21d2e1e8d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:09.987466 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-de87fddf-d2d2-4316-a3c7-3bc21d2e1e8d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:09.988078 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-de87fddf-d2d2-4316-a3c7-3bc21d2e1e8d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:10.119854 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-de87fddf-d2d2-4316-a3c7-3bc21d2e1e8d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:10.128165 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-de87fddf-d2d2-4316-a3c7-3bc21d2e1e8d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.154503 Oct 26 11:19:10.128738 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 80/168] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:09 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:11.151467 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-04a5eaeb-8e6e-435f-a16f-8b35cb8ce75e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:11.152078 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-04a5eaeb-8e6e-435f-a16f-8b35cb8ce75e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:11.158467 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-04a5eaeb-8e6e-435f-a16f-8b35cb8ce75e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:11.158977 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-04a5eaeb-8e6e-435f-a16f-8b35cb8ce75e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:11.159467 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-04a5eaeb-8e6e-435f-a16f-8b35cb8ce75e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:11.160152 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-04a5eaeb-8e6e-435f-a16f-8b35cb8ce75e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:11.160636 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-04a5eaeb-8e6e-435f-a16f-8b35cb8ce75e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:11.161060 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-04a5eaeb-8e6e-435f-a16f-8b35cb8ce75e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:11.305978 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-04a5eaeb-8e6e-435f-a16f-8b35cb8ce75e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:11.315359 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-04a5eaeb-8e6e-435f-a16f-8b35cb8ce75e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.167768 Oct 26 11:19:11.315956 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 89/169] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:11 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:12.348640 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-1bc25ad6-d531-411c-9b0b-1a639a4507f9 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:12.349257 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-1bc25ad6-d531-411c-9b0b-1a639a4507f9 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:12.356537 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1bc25ad6-d531-411c-9b0b-1a639a4507f9 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:12.358086 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1bc25ad6-d531-411c-9b0b-1a639a4507f9 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:12.364797 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1bc25ad6-d531-411c-9b0b-1a639a4507f9 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:12.366491 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1bc25ad6-d531-411c-9b0b-1a639a4507f9 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:12.367277 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1bc25ad6-d531-411c-9b0b-1a639a4507f9 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:12.368626 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1bc25ad6-d531-411c-9b0b-1a639a4507f9 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:12.523963 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-1bc25ad6-d531-411c-9b0b-1a639a4507f9 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:12.532667 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-1bc25ad6-d531-411c-9b0b-1a639a4507f9 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.188287 Oct 26 11:19:12.548726 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 81/170] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:12 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:13.556090 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-23034b3d-77de-4b9e-aac2-4f3bb39202a0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:13.556698 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-23034b3d-77de-4b9e-aac2-4f3bb39202a0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:13.562881 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-23034b3d-77de-4b9e-aac2-4f3bb39202a0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:13.563365 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-23034b3d-77de-4b9e-aac2-4f3bb39202a0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:13.563826 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-23034b3d-77de-4b9e-aac2-4f3bb39202a0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:13.564762 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-23034b3d-77de-4b9e-aac2-4f3bb39202a0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:13.565153 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-23034b3d-77de-4b9e-aac2-4f3bb39202a0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:13.565754 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-23034b3d-77de-4b9e-aac2-4f3bb39202a0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:13.724259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-23034b3d-77de-4b9e-aac2-4f3bb39202a0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:13.733450 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-23034b3d-77de-4b9e-aac2-4f3bb39202a0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.181037 Oct 26 11:19:13.734487 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 90/171] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:13 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:14.557419 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-cf540a93-f0f0-4aff-8d1c-546d2622e383 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:14.557978 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-cf540a93-f0f0-4aff-8d1c-546d2622e383 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:14.564449 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cf540a93-f0f0-4aff-8d1c-546d2622e383 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:14.564931 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cf540a93-f0f0-4aff-8d1c-546d2622e383 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:14.565366 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cf540a93-f0f0-4aff-8d1c-546d2622e383 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:14.566050 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cf540a93-f0f0-4aff-8d1c-546d2622e383 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:14.566509 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cf540a93-f0f0-4aff-8d1c-546d2622e383 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:14.566951 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cf540a93-f0f0-4aff-8d1c-546d2622e383 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:14.591975 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-cf540a93-f0f0-4aff-8d1c-546d2622e383 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Going to try to terminate instance {{(pid=119305) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 11:19:14.735549 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:19:14.757313 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-f0bfbf44-3cb1-46a9-973c-d47ef6b415a2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:14.757929 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-f0bfbf44-3cb1-46a9-973c-d47ef6b415a2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:14.764165 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f0bfbf44-3cb1-46a9-973c-d47ef6b415a2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:14.764650 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f0bfbf44-3cb1-46a9-973c-d47ef6b415a2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:14.765092 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f0bfbf44-3cb1-46a9-973c-d47ef6b415a2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:14.766399 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f0bfbf44-3cb1-46a9-973c-d47ef6b415a2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:14.766889 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f0bfbf44-3cb1-46a9-973c-d47ef6b415a2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:14.767319 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f0bfbf44-3cb1-46a9-973c-d47ef6b415a2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:14.848384 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-cf540a93-f0f0-4aff-8d1c-546d2622e383 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 204 len: 0 microversion: 2.1 time: 0.294543 Oct 26 11:19:14.849026 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 82/172] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Oct 26 11:19:14 2022] DELETE /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 11:19:14.858376 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-b84fd9de-2123-4b58-b414-8fa2f7d81f83 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:14.859824 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-b84fd9de-2123-4b58-b414-8fa2f7d81f83 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:14.866416 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b84fd9de-2123-4b58-b414-8fa2f7d81f83 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:14.866926 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b84fd9de-2123-4b58-b414-8fa2f7d81f83 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:14.867366 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b84fd9de-2123-4b58-b414-8fa2f7d81f83 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:14.868076 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b84fd9de-2123-4b58-b414-8fa2f7d81f83 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:14.868797 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b84fd9de-2123-4b58-b414-8fa2f7d81f83 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:14.869227 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b84fd9de-2123-4b58-b414-8fa2f7d81f83 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:14.900464 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-f0bfbf44-3cb1-46a9-973c-d47ef6b415a2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:14.908869 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-f0bfbf44-3cb1-46a9-973c-d47ef6b415a2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.155900 Oct 26 11:19:14.909446 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 91/173] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:14 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:19:15.007496 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-b84fd9de-2123-4b58-b414-8fa2f7d81f83 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:15.015530 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-b84fd9de-2123-4b58-b414-8fa2f7d81f83 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1553 microversion: 2.1 time: 0.162302 Oct 26 11:19:15.016104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 83/174] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:14 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:19:15.932917 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-541df716-f6b3-4051-b64f-d503f7dc6c8e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:15.933548 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-541df716-f6b3-4051-b64f-d503f7dc6c8e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:15.939986 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-541df716-f6b3-4051-b64f-d503f7dc6c8e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:15.940463 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-541df716-f6b3-4051-b64f-d503f7dc6c8e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:15.940886 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-541df716-f6b3-4051-b64f-d503f7dc6c8e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:15.941558 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-541df716-f6b3-4051-b64f-d503f7dc6c8e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:15.942002 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-541df716-f6b3-4051-b64f-d503f7dc6c8e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:15.942417 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-541df716-f6b3-4051-b64f-d503f7dc6c8e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:16.039560 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-372d5c16-963c-4309-a8df-64d432c89723 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:16.040179 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-372d5c16-963c-4309-a8df-64d432c89723 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:16.047897 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-372d5c16-963c-4309-a8df-64d432c89723 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:16.048659 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-372d5c16-963c-4309-a8df-64d432c89723 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:16.049100 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-372d5c16-963c-4309-a8df-64d432c89723 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:16.049804 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-372d5c16-963c-4309-a8df-64d432c89723 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:16.050262 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-372d5c16-963c-4309-a8df-64d432c89723 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:16.050790 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-372d5c16-963c-4309-a8df-64d432c89723 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:16.076557 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-541df716-f6b3-4051-b64f-d503f7dc6c8e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:16.084272 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-541df716-f6b3-4051-b64f-d503f7dc6c8e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.155347 Oct 26 11:19:16.084850 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 92/175] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:15 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:16.179551 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-372d5c16-963c-4309-a8df-64d432c89723 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:16.188285 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-372d5c16-963c-4309-a8df-64d432c89723 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1553 microversion: 2.1 time: 0.152397 Oct 26 11:19:16.188855 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 84/176] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:16 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:19:17.107125 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-88039b72-c133-465f-b68d-06e9afe1a300 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:17.107745 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-88039b72-c133-465f-b68d-06e9afe1a300 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:17.114241 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-88039b72-c133-465f-b68d-06e9afe1a300 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:17.114722 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-88039b72-c133-465f-b68d-06e9afe1a300 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:17.115189 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-88039b72-c133-465f-b68d-06e9afe1a300 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:17.115869 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-88039b72-c133-465f-b68d-06e9afe1a300 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:17.116318 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-88039b72-c133-465f-b68d-06e9afe1a300 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:17.116737 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-88039b72-c133-465f-b68d-06e9afe1a300 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:17.211652 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-adc9be54-6de5-4b7c-8d5d-5c7532aacd8d tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:17.212258 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-adc9be54-6de5-4b7c-8d5d-5c7532aacd8d tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:17.218438 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-adc9be54-6de5-4b7c-8d5d-5c7532aacd8d tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:17.219571 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-adc9be54-6de5-4b7c-8d5d-5c7532aacd8d tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:17.220008 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-adc9be54-6de5-4b7c-8d5d-5c7532aacd8d tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:17.220690 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-adc9be54-6de5-4b7c-8d5d-5c7532aacd8d tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:17.221134 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-adc9be54-6de5-4b7c-8d5d-5c7532aacd8d tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:17.221574 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-adc9be54-6de5-4b7c-8d5d-5c7532aacd8d tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:17.241460 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-88039b72-c133-465f-b68d-06e9afe1a300 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:17.249585 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-88039b72-c133-465f-b68d-06e9afe1a300 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.146276 Oct 26 11:19:17.250197 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 93/177] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:17 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:17.348477 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-adc9be54-6de5-4b7c-8d5d-5c7532aacd8d tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:17.356647 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-adc9be54-6de5-4b7c-8d5d-5c7532aacd8d tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1553 microversion: 2.1 time: 0.148845 Oct 26 11:19:17.357268 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 85/178] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:17 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:19:18.273117 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-f25d9eaa-8bac-47f6-8004-e3e05e1af20c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:18.273649 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-f25d9eaa-8bac-47f6-8004-e3e05e1af20c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:18.279572 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f25d9eaa-8bac-47f6-8004-e3e05e1af20c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:18.280059 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f25d9eaa-8bac-47f6-8004-e3e05e1af20c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:18.280504 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f25d9eaa-8bac-47f6-8004-e3e05e1af20c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:18.281195 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f25d9eaa-8bac-47f6-8004-e3e05e1af20c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:18.282232 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f25d9eaa-8bac-47f6-8004-e3e05e1af20c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:18.282660 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f25d9eaa-8bac-47f6-8004-e3e05e1af20c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:18.380176 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-ff30ad8d-b80a-4e64-a0ea-941d59c4c51f tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:18.380785 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-ff30ad8d-b80a-4e64-a0ea-941d59c4c51f tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:18.387076 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ff30ad8d-b80a-4e64-a0ea-941d59c4c51f tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:18.387551 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ff30ad8d-b80a-4e64-a0ea-941d59c4c51f tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:18.387978 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ff30ad8d-b80a-4e64-a0ea-941d59c4c51f tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:18.388659 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ff30ad8d-b80a-4e64-a0ea-941d59c4c51f tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:18.389104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ff30ad8d-b80a-4e64-a0ea-941d59c4c51f tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:18.389519 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ff30ad8d-b80a-4e64-a0ea-941d59c4c51f tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:18.411802 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-f25d9eaa-8bac-47f6-8004-e3e05e1af20c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:18.419536 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-f25d9eaa-8bac-47f6-8004-e3e05e1af20c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.150419 Oct 26 11:19:18.420114 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 94/179] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:18 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:18.520958 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-ff30ad8d-b80a-4e64-a0ea-941d59c4c51f tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:18.529197 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-ff30ad8d-b80a-4e64-a0ea-941d59c4c51f tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1553 microversion: 2.1 time: 0.152759 Oct 26 11:19:18.529700 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 86/180] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:18 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:19.443081 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-852fa12b-90f3-4b24-845f-ded8c4c3c61a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:19.443688 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-852fa12b-90f3-4b24-845f-ded8c4c3c61a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:19.449606 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-852fa12b-90f3-4b24-845f-ded8c4c3c61a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:19.450090 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-852fa12b-90f3-4b24-845f-ded8c4c3c61a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:19.450527 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-852fa12b-90f3-4b24-845f-ded8c4c3c61a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:19.451249 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-852fa12b-90f3-4b24-845f-ded8c4c3c61a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:19.451702 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-852fa12b-90f3-4b24-845f-ded8c4c3c61a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:19.452122 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-852fa12b-90f3-4b24-845f-ded8c4c3c61a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:19.553895 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-5a6fc789-93c0-4a47-9f95-991d2b918174 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:19.554588 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-5a6fc789-93c0-4a47-9f95-991d2b918174 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:19.560787 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5a6fc789-93c0-4a47-9f95-991d2b918174 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:19.562544 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5a6fc789-93c0-4a47-9f95-991d2b918174 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:19.563017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5a6fc789-93c0-4a47-9f95-991d2b918174 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:19.563723 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5a6fc789-93c0-4a47-9f95-991d2b918174 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:19.564187 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5a6fc789-93c0-4a47-9f95-991d2b918174 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:19.564745 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5a6fc789-93c0-4a47-9f95-991d2b918174 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:19.579861 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-852fa12b-90f3-4b24-845f-ded8c4c3c61a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:19.587549 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-852fa12b-90f3-4b24-845f-ded8c4c3c61a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.148368 Oct 26 11:19:19.588114 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 95/181] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:19 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:19.694634 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-5a6fc789-93c0-4a47-9f95-991d2b918174 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:19.706142 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-5a6fc789-93c0-4a47-9f95-991d2b918174 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1553 microversion: 2.1 time: 0.157716 Oct 26 11:19:19.706857 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 87/182] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:19 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:19:20.610622 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-4c2ddde8-325d-461d-bf60-c192f59587d1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:20.611266 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-4c2ddde8-325d-461d-bf60-c192f59587d1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:20.617967 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4c2ddde8-325d-461d-bf60-c192f59587d1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:20.618440 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4c2ddde8-325d-461d-bf60-c192f59587d1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:20.618896 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4c2ddde8-325d-461d-bf60-c192f59587d1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:20.619619 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4c2ddde8-325d-461d-bf60-c192f59587d1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:20.620067 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4c2ddde8-325d-461d-bf60-c192f59587d1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:20.620489 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4c2ddde8-325d-461d-bf60-c192f59587d1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:20.730020 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-91df8d3b-e9df-46d0-9017-6d45073b7380 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:20.730623 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-91df8d3b-e9df-46d0-9017-6d45073b7380 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:20.737124 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-91df8d3b-e9df-46d0-9017-6d45073b7380 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:20.737597 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-91df8d3b-e9df-46d0-9017-6d45073b7380 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:20.738169 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-91df8d3b-e9df-46d0-9017-6d45073b7380 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:20.739059 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-91df8d3b-e9df-46d0-9017-6d45073b7380 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:20.739655 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-91df8d3b-e9df-46d0-9017-6d45073b7380 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:20.740846 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-91df8d3b-e9df-46d0-9017-6d45073b7380 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:20.768145 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-4c2ddde8-325d-461d-bf60-c192f59587d1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:20.785873 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-4c2ddde8-325d-461d-bf60-c192f59587d1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.179000 Oct 26 11:19:20.786457 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 96/183] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:20 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:20.892319 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-91df8d3b-e9df-46d0-9017-6d45073b7380 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:20.897548 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-91df8d3b-e9df-46d0-9017-6d45073b7380 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1553 microversion: 2.1 time: 0.171724 Oct 26 11:19:20.898134 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 88/184] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:20 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1553 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:21.679314 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-6fe54fa9-684b-4018-92c3-d9ea5943f38d req-ded98d5a-3c95-4db8-8f6a-f0dd3d323b03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db7d6af-35ae-45dd-922d-ee3f0251f4be", "name": "network-vif-deleted", "tag": "20595fc6-a44c-4ee8-ae66-ce10051ef26d"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:19:21.691782 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-6fe54fa9-684b-4018-92c3-d9ea5943f38d req-ded98d5a-3c95-4db8-8f6a-f0dd3d323b03 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:21.692310 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-6fe54fa9-684b-4018-92c3-d9ea5943f38d req-ded98d5a-3c95-4db8-8f6a-f0dd3d323b03 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:21.692958 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-6fe54fa9-684b-4018-92c3-d9ea5943f38d req-ded98d5a-3c95-4db8-8f6a-f0dd3d323b03 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:21.705296 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-6fe54fa9-684b-4018-92c3-d9ea5943f38d req-ded98d5a-3c95-4db8-8f6a-f0dd3d323b03 service nova] Creating event network-vif-deleted:20595fc6-a44c-4ee8-ae66-ce10051ef26d for instance 3db7d6af-35ae-45dd-922d-ee3f0251f4be on hv-cinder-81558 Oct 26 11:19:21.711604 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-6fe54fa9-684b-4018-92c3-d9ea5943f38d req-ded98d5a-3c95-4db8-8f6a-f0dd3d323b03 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035976 Oct 26 11:19:21.712206 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 97/185] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:19:21.811238 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-c4531245-1575-4b38-b912-acda5266f61c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:21.811874 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-c4531245-1575-4b38-b912-acda5266f61c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:21.818493 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c4531245-1575-4b38-b912-acda5266f61c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:21.819022 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c4531245-1575-4b38-b912-acda5266f61c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:21.819454 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c4531245-1575-4b38-b912-acda5266f61c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:21.820162 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c4531245-1575-4b38-b912-acda5266f61c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:21.820608 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c4531245-1575-4b38-b912-acda5266f61c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:21.821024 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c4531245-1575-4b38-b912-acda5266f61c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:21.921728 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-b6fea3a9-be07-4939-8dcd-50a90110f74c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:21.922560 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-b6fea3a9-be07-4939-8dcd-50a90110f74c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:21.929833 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b6fea3a9-be07-4939-8dcd-50a90110f74c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:21.930251 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b6fea3a9-be07-4939-8dcd-50a90110f74c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:21.930690 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b6fea3a9-be07-4939-8dcd-50a90110f74c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:21.931412 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b6fea3a9-be07-4939-8dcd-50a90110f74c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:21.931864 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b6fea3a9-be07-4939-8dcd-50a90110f74c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:21.932291 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b6fea3a9-be07-4939-8dcd-50a90110f74c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:21.957262 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-c4531245-1575-4b38-b912-acda5266f61c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:21.965784 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-c4531245-1575-4b38-b912-acda5266f61c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.158527 Oct 26 11:19:21.966688 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 89/186] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:21 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:19:22.019633 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-b6fea3a9-be07-4939-8dcd-50a90110f74c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:22.028084 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-b6fea3a9-be07-4939-8dcd-50a90110f74c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1346 microversion: 2.1 time: 0.110608 Oct 26 11:19:22.028655 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 98/187] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:21 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1346 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:19:22.990904 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-045f2e13-4b8e-438d-8885-df41b541fd7e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:22.991518 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-045f2e13-4b8e-438d-8885-df41b541fd7e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:22.998035 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-045f2e13-4b8e-438d-8885-df41b541fd7e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:22.998514 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-045f2e13-4b8e-438d-8885-df41b541fd7e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:22.999031 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-045f2e13-4b8e-438d-8885-df41b541fd7e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:22.999743 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-045f2e13-4b8e-438d-8885-df41b541fd7e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:23.000191 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-045f2e13-4b8e-438d-8885-df41b541fd7e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:23.000610 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-045f2e13-4b8e-438d-8885-df41b541fd7e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:23.054004 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-41c8e75c-ae2c-42da-9272-23cac9080f15 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:23.055642 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-41c8e75c-ae2c-42da-9272-23cac9080f15 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:23.070274 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-41c8e75c-ae2c-42da-9272-23cac9080f15 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:23.072226 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-41c8e75c-ae2c-42da-9272-23cac9080f15 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:23.079786 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-41c8e75c-ae2c-42da-9272-23cac9080f15 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:23.080810 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-41c8e75c-ae2c-42da-9272-23cac9080f15 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:23.081595 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-41c8e75c-ae2c-42da-9272-23cac9080f15 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:23.082805 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-41c8e75c-ae2c-42da-9272-23cac9080f15 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:23.126701 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-41c8e75c-ae2c-42da-9272-23cac9080f15 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:23.127220 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-41c8e75c-ae2c-42da-9272-23cac9080f15 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:23.127662 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-41c8e75c-ae2c-42da-9272-23cac9080f15 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:23.128138 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.objects.instance [None req-41c8e75c-ae2c-42da-9272-23cac9080f15 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lazy-loading 'fault' on Instance uuid 3db7d6af-35ae-45dd-922d-ee3f0251f4be {{(pid=119306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:19:23.171433 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-41c8e75c-ae2c-42da-9272-23cac9080f15 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd63f10220465c996e6c706f1ef4a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2375e01650824224b673bea3d06af9eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:23.181133 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-41c8e75c-ae2c-42da-9272-23cac9080f15 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 200 len: 1351 microversion: 2.1 time: 0.133178 Oct 26 11:19:23.181859 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 99/188] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:23 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 1351 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:19:23.311382 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-045f2e13-4b8e-438d-8885-df41b541fd7e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:23.324669 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-045f2e13-4b8e-438d-8885-df41b541fd7e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.338553 Oct 26 11:19:23.325476 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 90/189] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:22 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:24.204992 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e6aa7026-56d5-4aa8-8551-29db09bbb13c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:24.205655 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-e6aa7026-56d5-4aa8-8551-29db09bbb13c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:24.212037 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e6aa7026-56d5-4aa8-8551-29db09bbb13c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:24.212520 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e6aa7026-56d5-4aa8-8551-29db09bbb13c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:24.213361 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e6aa7026-56d5-4aa8-8551-29db09bbb13c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:24.218001 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e6aa7026-56d5-4aa8-8551-29db09bbb13c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:24.218001 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e6aa7026-56d5-4aa8-8551-29db09bbb13c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:24.218001 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e6aa7026-56d5-4aa8-8551-29db09bbb13c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:24.229603 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.wsgi [None req-e6aa7026-56d5-4aa8-8551-29db09bbb13c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] HTTP exception thrown: Instance 3db7d6af-35ae-45dd-922d-ee3f0251f4be could not be found. Oct 26 11:19:24.234196 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e6aa7026-56d5-4aa8-8551-29db09bbb13c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Request method failure captured: Oct 26 11:19:24.234196 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: request: GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be HTTP/1.1 Oct 26 11:19:24.234196 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept: application/json Oct 26 11:19:24.234196 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept-Encoding: identity Oct 26 11:19:24.234196 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Connection: close Oct 26 11:19:24.234196 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Length: 0 Oct 26 11:19:24.234196 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Type: application/json Oct 26 11:19:24.234196 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Host: 10.222.0.42 Oct 26 11:19:24.234196 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Openstack-System-Scope: None Oct 26 11:19:24.234196 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: User-Agent: python-urllib3/1.26.12 Oct 26 11:19:24.234196 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Auth-Token: gAAAAABjWRdxDJuV2uzkNPl9AM_edJUZOCWSU8i1eAp5B0O6nuyXb2Boe7dxPcHTpdOBCMmBs5-AnsW2jX2WyXtgYUT_NcYXozkznt_VyG5mUNJoIJjzcUNQqprLqwavKKrFXLZp8pvZr9KJjt26p4QeR8WdmMoRITdc51faXRVF6rV8PxfUFyA Oct 26 11:19:24.234196 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Id: None Oct 26 11:19:24.234196 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Name: None Oct 26 11:19:24.234196 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Identity-Status: Confirmed Oct 26 11:19:24.234196 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Is-Admin-Project: True Oct 26 11:19:24.234196 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Id: default Oct 26 11:19:24.234196 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Name: Default Oct 26 11:19:24.234196 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Id: 2375e01650824224b673bea3d06af9eb Oct 26 11:19:24.234196 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Name: tempest-DeleteServersTestJSON-1472479623 Oct 26 11:19:24.234196 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Role: member,reader Oct 26 11:19:24.234196 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Roles: member,reader Oct 26 11:19:24.235625 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2375e01650824224b673bea3d06af9eb", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2375e01650824224b673bea3d06af9eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2375e01650824224b673bea3d06af9eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2375e01650824224b673bea3d06af9eb"}]}] Oct 26 11:19:24.235625 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant: tempest-DeleteServersTestJSON-1472479623 Oct 26 11:19:24.235625 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Id: 2375e01650824224b673bea3d06af9eb Oct 26 11:19:24.235625 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Name: tempest-DeleteServersTestJSON-1472479623 Oct 26 11:19:24.235625 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User: tempest-DeleteServersTestJSON-1472479623-project Oct 26 11:19:24.235625 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Id: default Oct 26 11:19:24.235625 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Name: Default Oct 26 11:19:24.235625 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Id: fbbd63f10220465c996e6c706f1ef4a9 Oct 26 11:19:24.235625 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Name: tempest-DeleteServersTestJSON-1472479623-project Oct 26 11:19:24.235625 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: method: > Oct 26 11:19:24.235625 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: exception: Instance 3db7d6af-35ae-45dd-922d-ee3f0251f4be could not be found. Oct 26 11:19:24.235625 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: action_args: {'id': '3db7d6af-35ae-45dd-922d-ee3f0251f4be'} Oct 26 11:19:24.236468 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:19:24.236468 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:19:24.236468 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:19:24.236468 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:19:24.236468 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:19:24.236468 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:19:24.236468 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:19:24.236468 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:19:24.236468 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:19:24.236468 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:19:24.236468 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3db7d6af-35ae-45dd-922d-ee3f0251f4be could not be found. Oct 26 11:19:24.236468 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:19:24.236468 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:19:24.236468 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:19:24.236468 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:19:24.236468 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:19:24.236468 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:19:24.236468 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:19:24.236468 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:19:24.236468 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:19:24.237685 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:19:24.237685 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 11:19:24.237685 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 11:19:24.237685 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:19:24.237685 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:19:24.237685 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:19:24.237685 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:19:24.237685 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3db7d6af-35ae-45dd-922d-ee3f0251f4be could not be found. Oct 26 11:19:24.237685 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:19:24.237685 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:19:24.237685 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:19:24.237685 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:19:24.237685 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:19:24.237685 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:19:24.237685 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:19:24.237685 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:19:24.237685 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3db7d6af-35ae-45dd-922d-ee3f0251f4be could not be found. Oct 26 11:19:24.237685 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:19:24.238738 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e6aa7026-56d5-4aa8-8551-29db09bbb13c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Returning 404 to user: Instance 3db7d6af-35ae-45dd-922d-ee3f0251f4be could not be found. {{(pid=119306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:19:24.238738 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-e6aa7026-56d5-4aa8-8551-29db09bbb13c tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 404 len: 111 microversion: 2.1 time: 0.034799 Oct 26 11:19:24.238738 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 100/190] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:24 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:19:24.348728 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-95a8ba8c-4265-45a3-b651-74e63baaf247 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:24.349872 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-95a8ba8c-4265-45a3-b651-74e63baaf247 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:24.357452 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-95a8ba8c-4265-45a3-b651-74e63baaf247 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:24.358296 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-95a8ba8c-4265-45a3-b651-74e63baaf247 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:24.358899 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-95a8ba8c-4265-45a3-b651-74e63baaf247 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:24.359913 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-95a8ba8c-4265-45a3-b651-74e63baaf247 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:24.360201 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-95a8ba8c-4265-45a3-b651-74e63baaf247 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:24.360975 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-95a8ba8c-4265-45a3-b651-74e63baaf247 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:24.367814 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-2eb79a29-b802-4846-9ab7-b56fc5d24693 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:24.370108 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-2eb79a29-b802-4846-9ab7-b56fc5d24693 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:24.376670 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2eb79a29-b802-4846-9ab7-b56fc5d24693 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:24.377440 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2eb79a29-b802-4846-9ab7-b56fc5d24693 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:24.378043 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2eb79a29-b802-4846-9ab7-b56fc5d24693 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:24.378926 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2eb79a29-b802-4846-9ab7-b56fc5d24693 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:24.380158 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2eb79a29-b802-4846-9ab7-b56fc5d24693 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:24.380741 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2eb79a29-b802-4846-9ab7-b56fc5d24693 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:24.533908 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-95a8ba8c-4265-45a3-b651-74e63baaf247 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:24.543320 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-95a8ba8c-4265-45a3-b651-74e63baaf247 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.198272 Oct 26 11:19:24.544120 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 91/191] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:24 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:24.548125 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.wsgi [None req-2eb79a29-b802-4846-9ab7-b56fc5d24693 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] HTTP exception thrown: Instance 3db7d6af-35ae-45dd-922d-ee3f0251f4be could not be found. Oct 26 11:19:24.550282 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-2eb79a29-b802-4846-9ab7-b56fc5d24693 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Request method failure captured: Oct 26 11:19:24.550282 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: request: GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be/os-volume_attachments HTTP/1.1 Oct 26 11:19:24.550282 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept: application/json Oct 26 11:19:24.550282 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept-Encoding: identity Oct 26 11:19:24.550282 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Connection: close Oct 26 11:19:24.550282 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Length: 0 Oct 26 11:19:24.550282 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Type: application/json Oct 26 11:19:24.550282 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Host: 10.222.0.42 Oct 26 11:19:24.550282 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Openstack-System-Scope: None Oct 26 11:19:24.550282 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: User-Agent: python-urllib3/1.26.12 Oct 26 11:19:24.550282 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Auth-Token: gAAAAABjWRdxDJuV2uzkNPl9AM_edJUZOCWSU8i1eAp5B0O6nuyXb2Boe7dxPcHTpdOBCMmBs5-AnsW2jX2WyXtgYUT_NcYXozkznt_VyG5mUNJoIJjzcUNQqprLqwavKKrFXLZp8pvZr9KJjt26p4QeR8WdmMoRITdc51faXRVF6rV8PxfUFyA Oct 26 11:19:24.550282 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Id: None Oct 26 11:19:24.550282 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Name: None Oct 26 11:19:24.550282 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Identity-Status: Confirmed Oct 26 11:19:24.550282 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Is-Admin-Project: True Oct 26 11:19:24.550282 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Id: default Oct 26 11:19:24.550282 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Name: Default Oct 26 11:19:24.550282 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Id: 2375e01650824224b673bea3d06af9eb Oct 26 11:19:24.550282 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Name: tempest-DeleteServersTestJSON-1472479623 Oct 26 11:19:24.550282 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Role: member,reader Oct 26 11:19:24.550282 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Roles: member,reader Oct 26 11:19:24.552247 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2375e01650824224b673bea3d06af9eb", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2375e01650824224b673bea3d06af9eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2375e01650824224b673bea3d06af9eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2375e01650824224b673bea3d06af9eb"}]}] Oct 26 11:19:24.552247 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant: tempest-DeleteServersTestJSON-1472479623 Oct 26 11:19:24.552247 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Id: 2375e01650824224b673bea3d06af9eb Oct 26 11:19:24.552247 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Name: tempest-DeleteServersTestJSON-1472479623 Oct 26 11:19:24.552247 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User: tempest-DeleteServersTestJSON-1472479623-project Oct 26 11:19:24.552247 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Id: default Oct 26 11:19:24.552247 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Name: Default Oct 26 11:19:24.552247 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Id: fbbd63f10220465c996e6c706f1ef4a9 Oct 26 11:19:24.552247 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Name: tempest-DeleteServersTestJSON-1472479623-project Oct 26 11:19:24.552247 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: method: > Oct 26 11:19:24.552247 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: exception: Instance 3db7d6af-35ae-45dd-922d-ee3f0251f4be could not be found. Oct 26 11:19:24.552247 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: action_args: {'server_id': '3db7d6af-35ae-45dd-922d-ee3f0251f4be'} Oct 26 11:19:24.553067 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:19:24.553067 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:19:24.553067 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:19:24.553067 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:19:24.553067 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:19:24.553067 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:19:24.553067 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:19:24.553067 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:19:24.553067 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:19:24.553067 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:19:24.553067 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3db7d6af-35ae-45dd-922d-ee3f0251f4be could not be found. Oct 26 11:19:24.553067 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:19:24.553067 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:19:24.553067 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:19:24.553067 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:19:24.553067 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:19:24.553067 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:19:24.553067 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:19:24.553067 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:19:24.553067 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:19:24.554320 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:19:24.554320 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 11:19:24.554320 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 11:19:24.554320 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 26 11:19:24.554320 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 11:19:24.554320 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 26 11:19:24.554320 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 26 11:19:24.554320 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:19:24.554320 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:19:24.554320 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3db7d6af-35ae-45dd-922d-ee3f0251f4be could not be found. Oct 26 11:19:24.554320 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:19:24.554320 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:19:24.554320 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:19:24.554320 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:19:24.554320 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:19:24.554320 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:19:24.554320 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:19:24.554320 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:19:24.554320 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3db7d6af-35ae-45dd-922d-ee3f0251f4be could not be found. Oct 26 11:19:24.554320 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:19:24.555390 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-2eb79a29-b802-4846-9ab7-b56fc5d24693 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Returning 404 to user: Instance 3db7d6af-35ae-45dd-922d-ee3f0251f4be could not be found. {{(pid=119306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:19:24.555390 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-2eb79a29-b802-4846-9ab7-b56fc5d24693 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.190798 Oct 26 11:19:24.555390 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 101/192] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Oct 26 11:19:24 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be/os-volume_attachments => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 11:19:25.567863 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-fac4b567-51a0-4cdb-8316-d8ab4fb2ba61 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:25.568506 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-fac4b567-51a0-4cdb-8316-d8ab4fb2ba61 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:25.575506 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fac4b567-51a0-4cdb-8316-d8ab4fb2ba61 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:25.576017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fac4b567-51a0-4cdb-8316-d8ab4fb2ba61 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:25.576473 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fac4b567-51a0-4cdb-8316-d8ab4fb2ba61 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:25.582569 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fac4b567-51a0-4cdb-8316-d8ab4fb2ba61 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:25.583623 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fac4b567-51a0-4cdb-8316-d8ab4fb2ba61 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:25.584741 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fac4b567-51a0-4cdb-8316-d8ab4fb2ba61 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:25.725472 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-fac4b567-51a0-4cdb-8316-d8ab4fb2ba61 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:25.733127 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-fac4b567-51a0-4cdb-8316-d8ab4fb2ba61 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.169023 Oct 26 11:19:25.733762 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 92/193] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:25 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:25.955318 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-2d3d3190-833e-4b01-a638-2cf43134e1ca tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:25.955831 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-2d3d3190-833e-4b01-a638-2cf43134e1ca tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:25.963004 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2d3d3190-833e-4b01-a638-2cf43134e1ca tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:25.963581 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2d3d3190-833e-4b01-a638-2cf43134e1ca tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:25.964089 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2d3d3190-833e-4b01-a638-2cf43134e1ca tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:25.964845 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2d3d3190-833e-4b01-a638-2cf43134e1ca tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:25.965502 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2d3d3190-833e-4b01-a638-2cf43134e1ca tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:25.966121 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2d3d3190-833e-4b01-a638-2cf43134e1ca tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:25.979984 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.wsgi [None req-2d3d3190-833e-4b01-a638-2cf43134e1ca tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] HTTP exception thrown: Instance 3db7d6af-35ae-45dd-922d-ee3f0251f4be could not be found. Oct 26 11:19:25.981914 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-2d3d3190-833e-4b01-a638-2cf43134e1ca tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Request method failure captured: Oct 26 11:19:25.981914 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: request: DELETE /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be HTTP/1.1 Oct 26 11:19:25.981914 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept: application/json Oct 26 11:19:25.981914 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept-Encoding: identity Oct 26 11:19:25.981914 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Connection: close Oct 26 11:19:25.981914 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Length: 0 Oct 26 11:19:25.981914 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Type: application/json Oct 26 11:19:25.981914 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Host: 10.222.0.42 Oct 26 11:19:25.981914 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Openstack-System-Scope: None Oct 26 11:19:25.981914 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: User-Agent: python-urllib3/1.26.12 Oct 26 11:19:25.981914 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Auth-Token: gAAAAABjWRdxDJuV2uzkNPl9AM_edJUZOCWSU8i1eAp5B0O6nuyXb2Boe7dxPcHTpdOBCMmBs5-AnsW2jX2WyXtgYUT_NcYXozkznt_VyG5mUNJoIJjzcUNQqprLqwavKKrFXLZp8pvZr9KJjt26p4QeR8WdmMoRITdc51faXRVF6rV8PxfUFyA Oct 26 11:19:25.981914 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Id: None Oct 26 11:19:25.981914 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Name: None Oct 26 11:19:25.981914 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Identity-Status: Confirmed Oct 26 11:19:25.981914 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Is-Admin-Project: True Oct 26 11:19:25.981914 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Id: default Oct 26 11:19:25.981914 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Name: Default Oct 26 11:19:25.981914 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Id: 2375e01650824224b673bea3d06af9eb Oct 26 11:19:25.981914 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Name: tempest-DeleteServersTestJSON-1472479623 Oct 26 11:19:25.981914 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Role: member,reader Oct 26 11:19:25.981914 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Roles: member,reader Oct 26 11:19:25.983338 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2375e01650824224b673bea3d06af9eb", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2375e01650824224b673bea3d06af9eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2375e01650824224b673bea3d06af9eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2375e01650824224b673bea3d06af9eb"}]}] Oct 26 11:19:25.983338 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant: tempest-DeleteServersTestJSON-1472479623 Oct 26 11:19:25.983338 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Id: 2375e01650824224b673bea3d06af9eb Oct 26 11:19:25.983338 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Name: tempest-DeleteServersTestJSON-1472479623 Oct 26 11:19:25.983338 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User: tempest-DeleteServersTestJSON-1472479623-project Oct 26 11:19:25.983338 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Id: default Oct 26 11:19:25.983338 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Name: Default Oct 26 11:19:25.983338 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Id: fbbd63f10220465c996e6c706f1ef4a9 Oct 26 11:19:25.983338 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Name: tempest-DeleteServersTestJSON-1472479623-project Oct 26 11:19:25.983338 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: method: > Oct 26 11:19:25.983338 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: exception: Instance 3db7d6af-35ae-45dd-922d-ee3f0251f4be could not be found. Oct 26 11:19:25.983338 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: action_args: {'id': '3db7d6af-35ae-45dd-922d-ee3f0251f4be'} Oct 26 11:19:25.984286 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:19:25.984286 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:19:25.984286 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:19:25.984286 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:19:25.984286 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:19:25.984286 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:19:25.984286 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:19:25.984286 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:19:25.984286 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:19:25.984286 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:19:25.984286 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3db7d6af-35ae-45dd-922d-ee3f0251f4be could not be found. Oct 26 11:19:25.984286 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:19:25.984286 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:19:25.984286 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:19:25.984286 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:19:25.984286 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:19:25.984286 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:19:25.984286 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:19:25.984286 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:19:25.984286 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:19:25.985553 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:19:25.985553 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 11:19:25.985553 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 11:19:25.985553 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 11:19:25.985553 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 11:19:25.985553 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:19:25.985553 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:19:25.985553 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:19:25.985553 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:19:25.985553 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3db7d6af-35ae-45dd-922d-ee3f0251f4be could not be found. Oct 26 11:19:25.985553 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:19:25.985553 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:19:25.985553 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:19:25.985553 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:19:25.985553 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:19:25.985553 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:19:25.985553 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:19:25.985553 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:19:25.985553 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3db7d6af-35ae-45dd-922d-ee3f0251f4be could not be found. Oct 26 11:19:25.985553 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:19:25.987321 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-2d3d3190-833e-4b01-a638-2cf43134e1ca tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Returning 404 to user: Instance 3db7d6af-35ae-45dd-922d-ee3f0251f4be could not be found. {{(pid=119306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:19:25.987321 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-2d3d3190-833e-4b01-a638-2cf43134e1ca tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 404 len: 111 microversion: 2.1 time: 0.033282 Oct 26 11:19:25.987321 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 102/194] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Oct 26 11:19:25 2022] DELETE /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:19:25.995032 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-c2c730ca-eace-41df-a41a-722ebb84ddb3 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:25.995614 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-c2c730ca-eace-41df-a41a-722ebb84ddb3 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] [instance: 3db7d6af-35ae-45dd-922d-ee3f0251f4be] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:26.003201 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c2c730ca-eace-41df-a41a-722ebb84ddb3 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:26.009581 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c2c730ca-eace-41df-a41a-722ebb84ddb3 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:26.009581 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c2c730ca-eace-41df-a41a-722ebb84ddb3 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:26.009581 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c2c730ca-eace-41df-a41a-722ebb84ddb3 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:26.009581 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c2c730ca-eace-41df-a41a-722ebb84ddb3 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:26.010347 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c2c730ca-eace-41df-a41a-722ebb84ddb3 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:26.023038 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.wsgi [None req-c2c730ca-eace-41df-a41a-722ebb84ddb3 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] HTTP exception thrown: Instance 3db7d6af-35ae-45dd-922d-ee3f0251f4be could not be found. Oct 26 11:19:26.028031 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-c2c730ca-eace-41df-a41a-722ebb84ddb3 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Request method failure captured: Oct 26 11:19:26.028031 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: request: GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be HTTP/1.1 Oct 26 11:19:26.028031 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept: application/json Oct 26 11:19:26.028031 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept-Encoding: identity Oct 26 11:19:26.028031 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Connection: close Oct 26 11:19:26.028031 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Length: 0 Oct 26 11:19:26.028031 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Type: application/json Oct 26 11:19:26.028031 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Host: 10.222.0.42 Oct 26 11:19:26.028031 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Openstack-System-Scope: None Oct 26 11:19:26.028031 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: User-Agent: python-urllib3/1.26.12 Oct 26 11:19:26.028031 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Auth-Token: gAAAAABjWRdxDJuV2uzkNPl9AM_edJUZOCWSU8i1eAp5B0O6nuyXb2Boe7dxPcHTpdOBCMmBs5-AnsW2jX2WyXtgYUT_NcYXozkznt_VyG5mUNJoIJjzcUNQqprLqwavKKrFXLZp8pvZr9KJjt26p4QeR8WdmMoRITdc51faXRVF6rV8PxfUFyA Oct 26 11:19:26.028031 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Id: None Oct 26 11:19:26.028031 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Name: None Oct 26 11:19:26.028031 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Identity-Status: Confirmed Oct 26 11:19:26.028031 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Is-Admin-Project: True Oct 26 11:19:26.028031 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Id: default Oct 26 11:19:26.028031 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Name: Default Oct 26 11:19:26.028031 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Id: 2375e01650824224b673bea3d06af9eb Oct 26 11:19:26.028031 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Name: tempest-DeleteServersTestJSON-1472479623 Oct 26 11:19:26.028031 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Role: member,reader Oct 26 11:19:26.028031 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Roles: member,reader Oct 26 11:19:26.029379 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2375e01650824224b673bea3d06af9eb", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2375e01650824224b673bea3d06af9eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2375e01650824224b673bea3d06af9eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2375e01650824224b673bea3d06af9eb"}]}] Oct 26 11:19:26.029379 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant: tempest-DeleteServersTestJSON-1472479623 Oct 26 11:19:26.029379 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Id: 2375e01650824224b673bea3d06af9eb Oct 26 11:19:26.029379 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Name: tempest-DeleteServersTestJSON-1472479623 Oct 26 11:19:26.029379 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User: tempest-DeleteServersTestJSON-1472479623-project Oct 26 11:19:26.029379 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Id: default Oct 26 11:19:26.029379 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Name: Default Oct 26 11:19:26.029379 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Id: fbbd63f10220465c996e6c706f1ef4a9 Oct 26 11:19:26.029379 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Name: tempest-DeleteServersTestJSON-1472479623-project Oct 26 11:19:26.029379 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: method: > Oct 26 11:19:26.029379 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: exception: Instance 3db7d6af-35ae-45dd-922d-ee3f0251f4be could not be found. Oct 26 11:19:26.029379 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: action_args: {'id': '3db7d6af-35ae-45dd-922d-ee3f0251f4be'} Oct 26 11:19:26.030154 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:19:26.030154 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:19:26.030154 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:19:26.030154 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:19:26.030154 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:19:26.030154 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:19:26.030154 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:19:26.030154 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:19:26.030154 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:19:26.030154 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:19:26.030154 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3db7d6af-35ae-45dd-922d-ee3f0251f4be could not be found. Oct 26 11:19:26.030154 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:19:26.030154 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:19:26.030154 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:19:26.030154 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:19:26.030154 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:19:26.030154 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:19:26.030154 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:19:26.030154 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:19:26.030154 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:19:26.031489 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:19:26.031489 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 11:19:26.031489 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 11:19:26.031489 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:19:26.031489 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:19:26.031489 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:19:26.031489 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:19:26.031489 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3db7d6af-35ae-45dd-922d-ee3f0251f4be could not be found. Oct 26 11:19:26.031489 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:19:26.031489 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:19:26.031489 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:19:26.031489 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:19:26.031489 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:19:26.031489 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:19:26.031489 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:19:26.031489 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:19:26.031489 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3db7d6af-35ae-45dd-922d-ee3f0251f4be could not be found. Oct 26 11:19:26.031489 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:19:26.033651 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-c2c730ca-eace-41df-a41a-722ebb84ddb3 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] Returning 404 to user: Instance 3db7d6af-35ae-45dd-922d-ee3f0251f4be could not be found. {{(pid=119305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:19:26.034481 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-c2c730ca-eace-41df-a41a-722ebb84ddb3 tempest-DeleteServersTestJSON-1472479623 tempest-DeleteServersTestJSON-1472479623-project] 10.222.0.42 "GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be" status: 404 len: 111 microversion: 2.1 time: 0.043521 Oct 26 11:19:26.035059 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 93/195] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:25 2022] GET /compute/v2.1/servers/3db7d6af-35ae-45dd-922d-ee3f0251f4be => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:19:26.756756 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-f967bf4a-682d-4cdf-b139-fe63a4910405 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:26.762008 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-f967bf4a-682d-4cdf-b139-fe63a4910405 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:26.763614 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f967bf4a-682d-4cdf-b139-fe63a4910405 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:26.764093 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f967bf4a-682d-4cdf-b139-fe63a4910405 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:26.764699 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f967bf4a-682d-4cdf-b139-fe63a4910405 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:26.765386 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f967bf4a-682d-4cdf-b139-fe63a4910405 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:26.765834 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f967bf4a-682d-4cdf-b139-fe63a4910405 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:26.766246 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f967bf4a-682d-4cdf-b139-fe63a4910405 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:27.016597 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-f967bf4a-682d-4cdf-b139-fe63a4910405 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:27.023728 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-f967bf4a-682d-4cdf-b139-fe63a4910405 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.271331 Oct 26 11:19:27.024643 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 103/196] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:26 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:28.048534 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-29c08598-a30a-4e14-b34d-c713a181fd45 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:28.049752 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-29c08598-a30a-4e14-b34d-c713a181fd45 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:28.056425 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-29c08598-a30a-4e14-b34d-c713a181fd45 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:28.057103 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-29c08598-a30a-4e14-b34d-c713a181fd45 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:28.057630 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-29c08598-a30a-4e14-b34d-c713a181fd45 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:28.058314 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-29c08598-a30a-4e14-b34d-c713a181fd45 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:28.058765 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-29c08598-a30a-4e14-b34d-c713a181fd45 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:28.059227 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-29c08598-a30a-4e14-b34d-c713a181fd45 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:28.216421 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-29c08598-a30a-4e14-b34d-c713a181fd45 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:28.225193 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-29c08598-a30a-4e14-b34d-c713a181fd45 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.180881 Oct 26 11:19:28.225875 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 94/197] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:28 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:29.249366 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-1646b3fe-841e-42d6-8cda-b62b1c59e92c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:29.249973 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-1646b3fe-841e-42d6-8cda-b62b1c59e92c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:29.256233 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=47 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:19:29.257956 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1646b3fe-841e-42d6-8cda-b62b1c59e92c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:29.258603 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1646b3fe-841e-42d6-8cda-b62b1c59e92c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:29.259274 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1646b3fe-841e-42d6-8cda-b62b1c59e92c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:29.260160 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1646b3fe-841e-42d6-8cda-b62b1c59e92c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:29.260800 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1646b3fe-841e-42d6-8cda-b62b1c59e92c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:29.261404 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1646b3fe-841e-42d6-8cda-b62b1c59e92c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:30.073806 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-1646b3fe-841e-42d6-8cda-b62b1c59e92c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:30.081712 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-1646b3fe-841e-42d6-8cda-b62b1c59e92c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.836350 Oct 26 11:19:30.082291 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 104/198] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:29 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:31.105905 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-9325bc53-463b-469a-a8ad-5a54bb9b83d4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:31.106387 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-9325bc53-463b-469a-a8ad-5a54bb9b83d4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:31.114086 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9325bc53-463b-469a-a8ad-5a54bb9b83d4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:31.114583 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9325bc53-463b-469a-a8ad-5a54bb9b83d4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:31.115592 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9325bc53-463b-469a-a8ad-5a54bb9b83d4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:31.116298 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9325bc53-463b-469a-a8ad-5a54bb9b83d4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:31.116748 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9325bc53-463b-469a-a8ad-5a54bb9b83d4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:31.117184 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9325bc53-463b-469a-a8ad-5a54bb9b83d4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:31.378694 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-9325bc53-463b-469a-a8ad-5a54bb9b83d4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:31.399660 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-9325bc53-463b-469a-a8ad-5a54bb9b83d4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.297799 Oct 26 11:19:31.401457 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 95/199] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:31 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:32.423460 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-3c1abe32-f6c8-4563-a35e-d055117f4b3c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:32.424062 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-3c1abe32-f6c8-4563-a35e-d055117f4b3c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:32.430500 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3c1abe32-f6c8-4563-a35e-d055117f4b3c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:32.431067 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3c1abe32-f6c8-4563-a35e-d055117f4b3c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:32.431735 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3c1abe32-f6c8-4563-a35e-d055117f4b3c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:32.432594 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3c1abe32-f6c8-4563-a35e-d055117f4b3c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:32.433042 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3c1abe32-f6c8-4563-a35e-d055117f4b3c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:32.433650 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3c1abe32-f6c8-4563-a35e-d055117f4b3c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:32.655239 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-3c1abe32-f6c8-4563-a35e-d055117f4b3c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:32.660885 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-3c1abe32-f6c8-4563-a35e-d055117f4b3c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.241268 Oct 26 11:19:32.662659 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 105/200] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:32 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:33.687100 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-4082dc42-9232-492c-82c9-8698fe1f0397 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:33.687806 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-4082dc42-9232-492c-82c9-8698fe1f0397 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:33.694529 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4082dc42-9232-492c-82c9-8698fe1f0397 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:33.695244 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4082dc42-9232-492c-82c9-8698fe1f0397 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:33.695686 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4082dc42-9232-492c-82c9-8698fe1f0397 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:33.696681 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4082dc42-9232-492c-82c9-8698fe1f0397 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:33.697172 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4082dc42-9232-492c-82c9-8698fe1f0397 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:33.697598 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4082dc42-9232-492c-82c9-8698fe1f0397 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:33.952708 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-4082dc42-9232-492c-82c9-8698fe1f0397 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:33.963378 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-4082dc42-9232-492c-82c9-8698fe1f0397 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.280295 Oct 26 11:19:33.973006 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 96/201] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:33 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:34.987744 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-36e4772a-d31d-441d-a9e1-f184ec9b82a5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:34.989671 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-36e4772a-d31d-441d-a9e1-f184ec9b82a5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:34.996192 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-36e4772a-d31d-441d-a9e1-f184ec9b82a5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:34.996923 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-36e4772a-d31d-441d-a9e1-f184ec9b82a5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:34.997587 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-36e4772a-d31d-441d-a9e1-f184ec9b82a5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:34.998277 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-36e4772a-d31d-441d-a9e1-f184ec9b82a5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:34.998904 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-36e4772a-d31d-441d-a9e1-f184ec9b82a5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:34.999507 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-36e4772a-d31d-441d-a9e1-f184ec9b82a5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:35.020547 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=100 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:19:35.193156 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-36e4772a-d31d-441d-a9e1-f184ec9b82a5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:35.202557 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-36e4772a-d31d-441d-a9e1-f184ec9b82a5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.219017 Oct 26 11:19:35.203384 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 106/202] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:34 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:19:36.229010 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-95f5d246-031d-47bc-a773-048b3495ea39 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:36.229639 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-95f5d246-031d-47bc-a773-048b3495ea39 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:36.239731 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-95f5d246-031d-47bc-a773-048b3495ea39 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:36.240525 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-95f5d246-031d-47bc-a773-048b3495ea39 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:36.241753 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-95f5d246-031d-47bc-a773-048b3495ea39 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:36.242832 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-95f5d246-031d-47bc-a773-048b3495ea39 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:36.245703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-95f5d246-031d-47bc-a773-048b3495ea39 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:36.245703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-95f5d246-031d-47bc-a773-048b3495ea39 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:36.393281 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-95f5d246-031d-47bc-a773-048b3495ea39 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:36.405116 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-95f5d246-031d-47bc-a773-048b3495ea39 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.180632 Oct 26 11:19:36.406252 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 97/203] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:36 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:37.429921 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-65428009-cb05-44e9-8926-d4b26ac426dd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:37.431323 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-65428009-cb05-44e9-8926-d4b26ac426dd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:37.437922 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-65428009-cb05-44e9-8926-d4b26ac426dd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:37.438781 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-65428009-cb05-44e9-8926-d4b26ac426dd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:37.439480 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-65428009-cb05-44e9-8926-d4b26ac426dd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:37.440441 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-65428009-cb05-44e9-8926-d4b26ac426dd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:37.441138 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-65428009-cb05-44e9-8926-d4b26ac426dd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:37.441772 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-65428009-cb05-44e9-8926-d4b26ac426dd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:37.686391 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-65428009-cb05-44e9-8926-d4b26ac426dd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:37.701140 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-65428009-cb05-44e9-8926-d4b26ac426dd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.275294 Oct 26 11:19:37.702231 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 107/204] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:37 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:38.724765 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-b224c5f1-5de3-4500-b90a-bad89f94b775 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:38.726686 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-b224c5f1-5de3-4500-b90a-bad89f94b775 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:38.733260 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:19:38.735625 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b224c5f1-5de3-4500-b90a-bad89f94b775 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:38.738538 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b224c5f1-5de3-4500-b90a-bad89f94b775 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:38.738538 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b224c5f1-5de3-4500-b90a-bad89f94b775 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:38.738538 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b224c5f1-5de3-4500-b90a-bad89f94b775 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:38.738538 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b224c5f1-5de3-4500-b90a-bad89f94b775 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:38.739396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b224c5f1-5de3-4500-b90a-bad89f94b775 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:38.930557 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-b224c5f1-5de3-4500-b90a-bad89f94b775 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:38.937884 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-b224c5f1-5de3-4500-b90a-bad89f94b775 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.217312 Oct 26 11:19:38.938687 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 98/205] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:38 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:39.969712 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-3b87ceb8-ed36-4322-a496-8da243887149 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:39.980341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-3b87ceb8-ed36-4322-a496-8da243887149 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:39.996854 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3b87ceb8-ed36-4322-a496-8da243887149 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:39.998528 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3b87ceb8-ed36-4322-a496-8da243887149 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:39.999192 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3b87ceb8-ed36-4322-a496-8da243887149 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:40.001632 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3b87ceb8-ed36-4322-a496-8da243887149 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:40.003089 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3b87ceb8-ed36-4322-a496-8da243887149 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:40.011305 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3b87ceb8-ed36-4322-a496-8da243887149 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:40.174323 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-3b87ceb8-ed36-4322-a496-8da243887149 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:40.191710 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-3b87ceb8-ed36-4322-a496-8da243887149 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.229343 Oct 26 11:19:40.191710 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 108/206] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:39 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:41.214754 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-b2d9b341-e0cf-4b7e-ad43-d182a1d11d0e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:41.219720 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-b2d9b341-e0cf-4b7e-ad43-d182a1d11d0e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:41.222539 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b2d9b341-e0cf-4b7e-ad43-d182a1d11d0e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:41.223242 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b2d9b341-e0cf-4b7e-ad43-d182a1d11d0e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:41.223832 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b2d9b341-e0cf-4b7e-ad43-d182a1d11d0e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:41.224701 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b2d9b341-e0cf-4b7e-ad43-d182a1d11d0e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:41.225297 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b2d9b341-e0cf-4b7e-ad43-d182a1d11d0e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:41.226560 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b2d9b341-e0cf-4b7e-ad43-d182a1d11d0e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:41.453257 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-b2d9b341-e0cf-4b7e-ad43-d182a1d11d0e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:41.466094 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-b2d9b341-e0cf-4b7e-ad43-d182a1d11d0e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.255306 Oct 26 11:19:41.479851 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 99/207] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:41 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:42.242380 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-272b2245-cd6c-48d0-b20a-58c90e5d5e68 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Action: 'create', calling method: .version_select at 0x7f6b9491b1f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2012182741", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9DdNjwTo0ccpxTEEHdqR94xBYTYPwzgY2YB6TR4C49BDrBPvfGjwin1RS2GxN+df1xON/GowWXzhPGGef7/DPFOj+5T/WDcVciJ+XLr14BNSToYKtXCPZmpmzbZEhmaA=="}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:19:42.284755 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-272b2245-cd6c-48d0-b20a-58c90e5d5e68 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Getting quotas for project a30976e8b35f436b84dc4488dcf5acaf. Resources: {'key_pairs'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:19:42.289684 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-272b2245-cd6c-48d0-b20a-58c90e5d5e68 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Getting quotas for user ce09c776cd77416091ea214b858afacd and project a30976e8b35f436b84dc4488dcf5acaf. Resources: {'key_pairs'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:19:42.415909 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-272b2245-cd6c-48d0-b20a-58c90e5d5e68 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.410714 Oct 26 11:19:42.416944 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 109/208] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Oct 26 11:19:42 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:19:42.490888 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-65fc9ea7-5507-4b95-8b3f-6483be541fdc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:42.492211 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-65fc9ea7-5507-4b95-8b3f-6483be541fdc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:42.501629 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-65fc9ea7-5507-4b95-8b3f-6483be541fdc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:42.502315 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-65fc9ea7-5507-4b95-8b3f-6483be541fdc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:42.502929 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-65fc9ea7-5507-4b95-8b3f-6483be541fdc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:42.504638 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-65fc9ea7-5507-4b95-8b3f-6483be541fdc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:42.505325 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-65fc9ea7-5507-4b95-8b3f-6483be541fdc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:42.505912 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-65fc9ea7-5507-4b95-8b3f-6483be541fdc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:42.516952 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=100 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:19:42.734589 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-65fc9ea7-5507-4b95-8b3f-6483be541fdc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:42.754977 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-65fc9ea7-5507-4b95-8b3f-6483be541fdc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.265895 Oct 26 11:19:42.757106 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 100/209] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:42 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:43.780576 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-36260b73-c1d1-4b89-8166-20c0ab73b55a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:43.781007 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-36260b73-c1d1-4b89-8166-20c0ab73b55a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:43.787377 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-36260b73-c1d1-4b89-8166-20c0ab73b55a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:43.787873 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-36260b73-c1d1-4b89-8166-20c0ab73b55a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:43.788306 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-36260b73-c1d1-4b89-8166-20c0ab73b55a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:43.789632 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-36260b73-c1d1-4b89-8166-20c0ab73b55a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:43.790091 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-36260b73-c1d1-4b89-8166-20c0ab73b55a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:43.790573 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-36260b73-c1d1-4b89-8166-20c0ab73b55a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:44.032045 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-36260b73-c1d1-4b89-8166-20c0ab73b55a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:44.042375 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-36260b73-c1d1-4b89-8166-20c0ab73b55a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.266525 Oct 26 11:19:44.045030 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 110/210] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:43 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:45.071135 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-e076d098-780c-4053-b4e1-b245176f3971 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:45.072931 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-e076d098-780c-4053-b4e1-b245176f3971 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:45.081151 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e076d098-780c-4053-b4e1-b245176f3971 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:45.081852 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e076d098-780c-4053-b4e1-b245176f3971 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:45.082472 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e076d098-780c-4053-b4e1-b245176f3971 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:45.083663 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e076d098-780c-4053-b4e1-b245176f3971 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:45.084276 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e076d098-780c-4053-b4e1-b245176f3971 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:45.084979 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e076d098-780c-4053-b4e1-b245176f3971 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:45.327808 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-e076d098-780c-4053-b4e1-b245176f3971 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:45.336986 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-e076d098-780c-4053-b4e1-b245176f3971 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.272670 Oct 26 11:19:45.337565 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 101/211] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:45 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:46.360612 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-5f9d8f33-d0e5-40a7-ac13-c10500c2673c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:46.361800 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-5f9d8f33-d0e5-40a7-ac13-c10500c2673c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:46.369787 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5f9d8f33-d0e5-40a7-ac13-c10500c2673c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:46.370537 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5f9d8f33-d0e5-40a7-ac13-c10500c2673c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:46.371217 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5f9d8f33-d0e5-40a7-ac13-c10500c2673c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:46.385421 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5f9d8f33-d0e5-40a7-ac13-c10500c2673c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:46.386033 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5f9d8f33-d0e5-40a7-ac13-c10500c2673c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:46.386548 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5f9d8f33-d0e5-40a7-ac13-c10500c2673c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:46.542146 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-5f9d8f33-d0e5-40a7-ac13-c10500c2673c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:46.551087 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-5f9d8f33-d0e5-40a7-ac13-c10500c2673c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1522 microversion: 2.1 time: 0.194303 Oct 26 11:19:46.551677 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 111/212] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:46 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:47.575876 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-cca11602-94d3-4e3c-93ca-0b26392a33f1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:47.576489 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-cca11602-94d3-4e3c-93ca-0b26392a33f1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:47.583824 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cca11602-94d3-4e3c-93ca-0b26392a33f1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:47.584413 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cca11602-94d3-4e3c-93ca-0b26392a33f1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:47.584954 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cca11602-94d3-4e3c-93ca-0b26392a33f1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:47.586026 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cca11602-94d3-4e3c-93ca-0b26392a33f1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:47.586131 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cca11602-94d3-4e3c-93ca-0b26392a33f1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:47.586734 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cca11602-94d3-4e3c-93ca-0b26392a33f1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:47.762766 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-cca11602-94d3-4e3c-93ca-0b26392a33f1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:47.771933 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-cca11602-94d3-4e3c-93ca-0b26392a33f1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1502 microversion: 2.1 time: 0.200056 Oct 26 11:19:47.773353 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 102/213] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:47 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1502 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:47.796186 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-1d9f08af-d21d-4047-b4af-7a029d708969 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:47.797376 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-1d9f08af-d21d-4047-b4af-7a029d708969 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:47.805861 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1d9f08af-d21d-4047-b4af-7a029d708969 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:47.808608 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1d9f08af-d21d-4047-b4af-7a029d708969 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:47.809062 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1d9f08af-d21d-4047-b4af-7a029d708969 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:47.809787 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1d9f08af-d21d-4047-b4af-7a029d708969 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:47.812826 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1d9f08af-d21d-4047-b4af-7a029d708969 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:47.813370 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1d9f08af-d21d-4047-b4af-7a029d708969 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:47.975688 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-1d9f08af-d21d-4047-b4af-7a029d708969 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:47.983930 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-1d9f08af-d21d-4047-b4af-7a029d708969 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1516 microversion: 2.1 time: 0.192414 Oct 26 11:19:47.984498 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 112/214] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:47 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1516 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:48.905410 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-e837d868-a437-4ce4-8f8d-921b470a383b tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-458557207", "imageRef": "ed8b5733-339c-4fa7-9767-abef514cb9f2", "flavorRef": "452", "networks": [{"uuid": "75a10cc7-b501-47b5-a507-62e78a6167f4"}]}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:19:48.987689 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.network.neutron [None req-e837d868-a437-4ce4-8f8d-921b470a383b tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] validate_networks() for [('75a10cc7-b501-47b5-a507-62e78a6167f4', None, None, None, None, None)] {{(pid=119305) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 11:19:49.576771 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-e837d868-a437-4ce4-8f8d-921b470a383b tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Flavor limits 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 11:19:49.576771 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-e837d868-a437-4ce4-8f8d-921b470a383b tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Image limits 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 11:19:49.576771 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-e837d868-a437-4ce4-8f8d-921b470a383b tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Flavor pref 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 11:19:49.576771 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-e837d868-a437-4ce4-8f8d-921b470a383b tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Image pref 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 11:19:49.576771 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-e837d868-a437-4ce4-8f8d-921b470a383b tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 11:19:49.585799 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e837d868-a437-4ce4-8f8d-921b470a383b tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:49.586297 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e837d868-a437-4ce4-8f8d-921b470a383b tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:49.586795 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e837d868-a437-4ce4-8f8d-921b470a383b tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:49.587539 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e837d868-a437-4ce4-8f8d-921b470a383b tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:49.588016 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e837d868-a437-4ce4-8f8d-921b470a383b tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:49.588431 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e837d868-a437-4ce4-8f8d-921b470a383b tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:49.605373 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.quota [None req-e837d868-a437-4ce4-8f8d-921b470a383b tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Getting quotas for project 8576eb9289f147f2ab9ba6f1c00b3ffd. Resources: {'cores', 'instances', 'ram'} {{(pid=119305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:19:49.609441 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.quota [None req-e837d868-a437-4ce4-8f8d-921b470a383b tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Getting quotas for user a79972df53cf4245be9c45a9b579cff9 and project 8576eb9289f147f2ab9ba6f1c00b3ffd. Resources: {'cores', 'instances', 'ram'} {{(pid=119305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:19:49.621948 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-e837d868-a437-4ce4-8f8d-921b470a383b tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Going to run 1 instances... {{(pid=119305) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 11:19:49.624284 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-e837d868-a437-4ce4-8f8d-921b470a383b tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: 01c8875e-d428-4653-8654-4ce0d4893ce2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed8b5733-339c-4fa7-9767-abef514cb9f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119305) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 11:19:49.793430 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-e837d868-a437-4ce4-8f8d-921b470a383b tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.893871 Oct 26 11:19:49.794103 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 103/215] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Oct 26 11:19:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 11:19:49.805666 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-d836791f-4763-4a2b-a664-bac7058accd8 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:49.806286 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-d836791f-4763-4a2b-a664-bac7058accd8 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: 01c8875e-d428-4653-8654-4ce0d4893ce2] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:49.871412 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-d836791f-4763-4a2b-a664-bac7058accd8 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:49.880958 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-d836791f-4763-4a2b-a664-bac7058accd8 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2" status: 200 len: 1213 microversion: 2.1 time: 0.079380 Oct 26 11:19:49.898285 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 113/216] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:49 2022] GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2 => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:19:50.836134 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-24a19298-7064-4b24-a1b0-6160bb1c5f2c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:19:50.838737 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-24a19298-7064-4b24-a1b0-6160bb1c5f2c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:50.847432 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-24a19298-7064-4b24-a1b0-6160bb1c5f2c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:50.847927 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-24a19298-7064-4b24-a1b0-6160bb1c5f2c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:50.848347 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-24a19298-7064-4b24-a1b0-6160bb1c5f2c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:50.849040 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-24a19298-7064-4b24-a1b0-6160bb1c5f2c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:50.849486 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-24a19298-7064-4b24-a1b0-6160bb1c5f2c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:50.849957 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-24a19298-7064-4b24-a1b0-6160bb1c5f2c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:50.875200 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.objects.instance [None req-24a19298-7064-4b24-a1b0-6160bb1c5f2c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lazy-loading 'flavor' on Instance uuid f2f70dba-88ab-42ae-ace7-b95eeac5fcfc {{(pid=119305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:19:50.920699 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-82551b48-b5cd-4171-bca7-b263fe73d115 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:50.922409 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-82551b48-b5cd-4171-bca7-b263fe73d115 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: 01c8875e-d428-4653-8654-4ce0d4893ce2] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:51.012439 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-82551b48-b5cd-4171-bca7-b263fe73d115 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:51.020783 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-82551b48-b5cd-4171-bca7-b263fe73d115 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2" status: 200 len: 1213 microversion: 2.1 time: 0.120214 Oct 26 11:19:51.021359 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 114/217] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:50 2022] GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2 => generated 1213 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:19:51.316497 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-24a19298-7064-4b24-a1b0-6160bb1c5f2c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "POST /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc/action" status: 200 len: 32 microversion: 2.1 time: 0.484427 Oct 26 11:19:51.318124 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 104/218] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Oct 26 11:19:50 2022] POST /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc/action => generated 32 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 11:19:51.328322 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-dcc3bb41-5574-4bce-8030-e63d64833958 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:51.329435 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-dcc3bb41-5574-4bce-8030-e63d64833958 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:51.336710 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dcc3bb41-5574-4bce-8030-e63d64833958 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:51.340186 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dcc3bb41-5574-4bce-8030-e63d64833958 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:51.340989 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dcc3bb41-5574-4bce-8030-e63d64833958 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:51.343535 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dcc3bb41-5574-4bce-8030-e63d64833958 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:51.344330 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dcc3bb41-5574-4bce-8030-e63d64833958 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:51.344931 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dcc3bb41-5574-4bce-8030-e63d64833958 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:51.619335 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-dcc3bb41-5574-4bce-8030-e63d64833958 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:51.634548 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-dcc3bb41-5574-4bce-8030-e63d64833958 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1522 microversion: 2.1 time: 0.306860 Oct 26 11:19:51.634548 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 115/219] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:51 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:19:52.045229 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-7ab8d035-169f-4cb5-8d49-2da69739bf36 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:52.045936 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-7ab8d035-169f-4cb5-8d49-2da69739bf36 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: 01c8875e-d428-4653-8654-4ce0d4893ce2] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:52.070182 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7ab8d035-169f-4cb5-8d49-2da69739bf36 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:52.071208 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7ab8d035-169f-4cb5-8d49-2da69739bf36 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:52.072372 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7ab8d035-169f-4cb5-8d49-2da69739bf36 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:52.073560 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7ab8d035-169f-4cb5-8d49-2da69739bf36 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:52.074224 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7ab8d035-169f-4cb5-8d49-2da69739bf36 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:52.074922 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7ab8d035-169f-4cb5-8d49-2da69739bf36 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:52.296302 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-7ab8d035-169f-4cb5-8d49-2da69739bf36 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:52.305242 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-7ab8d035-169f-4cb5-8d49-2da69739bf36 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2" status: 200 len: 1265 microversion: 2.1 time: 0.264525 Oct 26 11:19:52.306181 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 105/220] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:52 2022] GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2 => generated 1265 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:52.659655 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-7fdffaca-d47a-4f61-a1f2-71e17058e9bb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:52.660182 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-7fdffaca-d47a-4f61-a1f2-71e17058e9bb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:52.669093 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7fdffaca-d47a-4f61-a1f2-71e17058e9bb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:52.669628 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7fdffaca-d47a-4f61-a1f2-71e17058e9bb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:52.670284 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7fdffaca-d47a-4f61-a1f2-71e17058e9bb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:52.671188 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7fdffaca-d47a-4f61-a1f2-71e17058e9bb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:52.671818 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7fdffaca-d47a-4f61-a1f2-71e17058e9bb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:52.672291 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7fdffaca-d47a-4f61-a1f2-71e17058e9bb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:53.031854 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-7fdffaca-d47a-4f61-a1f2-71e17058e9bb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:53.043589 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-7fdffaca-d47a-4f61-a1f2-71e17058e9bb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1522 microversion: 2.1 time: 0.387785 Oct 26 11:19:53.047068 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 116/221] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:52 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1522 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:53.338328 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-d2860fd8-7b00-4bfa-b489-8b397d72be02 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:53.338987 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-d2860fd8-7b00-4bfa-b489-8b397d72be02 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: 01c8875e-d428-4653-8654-4ce0d4893ce2] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:53.351257 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d2860fd8-7b00-4bfa-b489-8b397d72be02 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:53.352894 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d2860fd8-7b00-4bfa-b489-8b397d72be02 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:53.352894 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d2860fd8-7b00-4bfa-b489-8b397d72be02 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:53.353086 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d2860fd8-7b00-4bfa-b489-8b397d72be02 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:53.353496 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d2860fd8-7b00-4bfa-b489-8b397d72be02 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:53.353923 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d2860fd8-7b00-4bfa-b489-8b397d72be02 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:53.426862 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-d2860fd8-7b00-4bfa-b489-8b397d72be02 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:53.435822 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-d2860fd8-7b00-4bfa-b489-8b397d72be02 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2" status: 200 len: 1271 microversion: 2.1 time: 0.102039 Oct 26 11:19:53.436401 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 106/222] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:53 2022] GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2 => generated 1271 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:54.068895 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-7b294dbf-9c26-4db9-863f-921827e63429 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:54.069496 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-7b294dbf-9c26-4db9-863f-921827e63429 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:54.081182 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7b294dbf-9c26-4db9-863f-921827e63429 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:54.081182 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7b294dbf-9c26-4db9-863f-921827e63429 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:54.081182 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7b294dbf-9c26-4db9-863f-921827e63429 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:54.081473 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7b294dbf-9c26-4db9-863f-921827e63429 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:54.081723 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7b294dbf-9c26-4db9-863f-921827e63429 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:54.082328 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7b294dbf-9c26-4db9-863f-921827e63429 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:54.325615 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-7b294dbf-9c26-4db9-863f-921827e63429 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:54.334086 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-7b294dbf-9c26-4db9-863f-921827e63429 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1522 microversion: 2.1 time: 0.269218 Oct 26 11:19:54.334668 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 117/223] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:54 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:54.464721 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-016df440-83fe-4b4d-bb61-8851bf41cfa3 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:54.465413 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-016df440-83fe-4b4d-bb61-8851bf41cfa3 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: 01c8875e-d428-4653-8654-4ce0d4893ce2] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:54.477588 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-016df440-83fe-4b4d-bb61-8851bf41cfa3 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:54.478858 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-016df440-83fe-4b4d-bb61-8851bf41cfa3 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:54.479483 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-016df440-83fe-4b4d-bb61-8851bf41cfa3 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:54.485247 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-016df440-83fe-4b4d-bb61-8851bf41cfa3 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:54.485247 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-016df440-83fe-4b4d-bb61-8851bf41cfa3 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:54.485247 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-016df440-83fe-4b4d-bb61-8851bf41cfa3 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:54.800208 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-016df440-83fe-4b4d-bb61-8851bf41cfa3 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:54.808638 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-016df440-83fe-4b4d-bb61-8851bf41cfa3 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2" status: 200 len: 1313 microversion: 2.1 time: 0.348072 Oct 26 11:19:54.810116 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 107/224] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:54 2022] GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2 => generated 1313 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:55.086285 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-8663f17a-8461-4a02-860e-3b1130e11678 req-a6de8da1-f1ef-48a2-a247-baba453c40df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01c8875e-d428-4653-8654-4ce0d4893ce2", "tag": "61c4a6a4-90ef-4263-98fc-44897522cba0"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:19:55.116803 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-8663f17a-8461-4a02-860e-3b1130e11678 req-a6de8da1-f1ef-48a2-a247-baba453c40df service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:55.117293 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-8663f17a-8461-4a02-860e-3b1130e11678 req-a6de8da1-f1ef-48a2-a247-baba453c40df service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:55.117788 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-8663f17a-8461-4a02-860e-3b1130e11678 req-a6de8da1-f1ef-48a2-a247-baba453c40df service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:55.137622 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-8663f17a-8461-4a02-860e-3b1130e11678 req-a6de8da1-f1ef-48a2-a247-baba453c40df service nova] Creating event network-changed:61c4a6a4-90ef-4263-98fc-44897522cba0 for instance 01c8875e-d428-4653-8654-4ce0d4893ce2 on hv-cinder-81558 Oct 26 11:19:55.153765 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-8663f17a-8461-4a02-860e-3b1130e11678 req-a6de8da1-f1ef-48a2-a247-baba453c40df service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072508 Oct 26 11:19:55.157264 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 118/225] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:19:55.376245 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-538b9b42-bd83-45d8-bf02-2e369c433a73 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:55.381103 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-538b9b42-bd83-45d8-bf02-2e369c433a73 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:55.402301 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-538b9b42-bd83-45d8-bf02-2e369c433a73 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:55.402983 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-538b9b42-bd83-45d8-bf02-2e369c433a73 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:55.403495 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-538b9b42-bd83-45d8-bf02-2e369c433a73 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:55.404274 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-538b9b42-bd83-45d8-bf02-2e369c433a73 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:55.407034 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-538b9b42-bd83-45d8-bf02-2e369c433a73 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:55.407940 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-538b9b42-bd83-45d8-bf02-2e369c433a73 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:55.699070 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-538b9b42-bd83-45d8-bf02-2e369c433a73 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:55.719005 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-538b9b42-bd83-45d8-bf02-2e369c433a73 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1522 microversion: 2.1 time: 0.357762 Oct 26 11:19:55.728736 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 108/226] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:55 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:55.839869 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-1307a091-9ea1-4a09-bcae-9fb312b7c3ec tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:55.841470 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-1307a091-9ea1-4a09-bcae-9fb312b7c3ec tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: 01c8875e-d428-4653-8654-4ce0d4893ce2] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:55.854429 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1307a091-9ea1-4a09-bcae-9fb312b7c3ec tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:55.855450 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1307a091-9ea1-4a09-bcae-9fb312b7c3ec tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:55.856805 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1307a091-9ea1-4a09-bcae-9fb312b7c3ec tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:55.857706 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1307a091-9ea1-4a09-bcae-9fb312b7c3ec tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:55.858342 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1307a091-9ea1-4a09-bcae-9fb312b7c3ec tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:55.858974 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1307a091-9ea1-4a09-bcae-9fb312b7c3ec tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:56.067340 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-1307a091-9ea1-4a09-bcae-9fb312b7c3ec tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:56.080542 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-1307a091-9ea1-4a09-bcae-9fb312b7c3ec tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2" status: 200 len: 1313 microversion: 2.1 time: 0.248205 Oct 26 11:19:56.084724 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 119/227] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:55 2022] GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:56.751167 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-7ebd95fb-c7e1-455b-8852-02db483ba740 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:56.751881 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-7ebd95fb-c7e1-455b-8852-02db483ba740 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:56.758297 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7ebd95fb-c7e1-455b-8852-02db483ba740 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:56.758778 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7ebd95fb-c7e1-455b-8852-02db483ba740 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:56.759247 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7ebd95fb-c7e1-455b-8852-02db483ba740 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:56.760592 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7ebd95fb-c7e1-455b-8852-02db483ba740 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:56.761107 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7ebd95fb-c7e1-455b-8852-02db483ba740 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:56.761534 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7ebd95fb-c7e1-455b-8852-02db483ba740 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:56.943876 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-7ebd95fb-c7e1-455b-8852-02db483ba740 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:56.956004 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-7ebd95fb-c7e1-455b-8852-02db483ba740 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1522 microversion: 2.1 time: 0.208751 Oct 26 11:19:56.961480 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 109/228] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:56 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:57.109768 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-6912241c-8376-4c01-87b1-c1ed0df3d2d7 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:57.111032 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-6912241c-8376-4c01-87b1-c1ed0df3d2d7 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: 01c8875e-d428-4653-8654-4ce0d4893ce2] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:57.117574 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6912241c-8376-4c01-87b1-c1ed0df3d2d7 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:57.118274 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6912241c-8376-4c01-87b1-c1ed0df3d2d7 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:57.118940 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6912241c-8376-4c01-87b1-c1ed0df3d2d7 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:57.120328 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6912241c-8376-4c01-87b1-c1ed0df3d2d7 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:57.120942 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6912241c-8376-4c01-87b1-c1ed0df3d2d7 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:57.121520 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6912241c-8376-4c01-87b1-c1ed0df3d2d7 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:57.383521 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-6912241c-8376-4c01-87b1-c1ed0df3d2d7 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:57.392806 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-6912241c-8376-4c01-87b1-c1ed0df3d2d7 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2" status: 200 len: 1313 microversion: 2.1 time: 0.286993 Oct 26 11:19:57.393400 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 120/229] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:57 2022] GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:57.979677 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-fe69f75f-d984-413d-bc5d-8d84da6ec228 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:57.980431 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-fe69f75f-d984-413d-bc5d-8d84da6ec228 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:57.987499 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fe69f75f-d984-413d-bc5d-8d84da6ec228 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:57.988066 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fe69f75f-d984-413d-bc5d-8d84da6ec228 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:57.988575 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fe69f75f-d984-413d-bc5d-8d84da6ec228 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:57.989515 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fe69f75f-d984-413d-bc5d-8d84da6ec228 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:57.990240 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fe69f75f-d984-413d-bc5d-8d84da6ec228 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:57.990885 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fe69f75f-d984-413d-bc5d-8d84da6ec228 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:58.172659 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-fe69f75f-d984-413d-bc5d-8d84da6ec228 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:58.182422 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-fe69f75f-d984-413d-bc5d-8d84da6ec228 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1522 microversion: 2.1 time: 0.205843 Oct 26 11:19:58.183491 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 110/230] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:57 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:58.419402 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-3437db93-9bc0-4c1b-b18f-ce8d215317e8 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:58.420712 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-3437db93-9bc0-4c1b-b18f-ce8d215317e8 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: 01c8875e-d428-4653-8654-4ce0d4893ce2] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:58.441915 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3437db93-9bc0-4c1b-b18f-ce8d215317e8 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:58.442697 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3437db93-9bc0-4c1b-b18f-ce8d215317e8 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:58.443327 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3437db93-9bc0-4c1b-b18f-ce8d215317e8 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:58.444246 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3437db93-9bc0-4c1b-b18f-ce8d215317e8 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:58.446110 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3437db93-9bc0-4c1b-b18f-ce8d215317e8 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:58.448412 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3437db93-9bc0-4c1b-b18f-ce8d215317e8 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:58.688552 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-3437db93-9bc0-4c1b-b18f-ce8d215317e8 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:58.711912 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-3437db93-9bc0-4c1b-b18f-ce8d215317e8 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2" status: 200 len: 1313 microversion: 2.1 time: 0.285600 Oct 26 11:19:58.711912 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 121/231] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:58 2022] GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2 => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:59.212029 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-54c7be84-a538-4d2b-912e-a973e44ed194 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:59.213002 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-54c7be84-a538-4d2b-912e-a973e44ed194 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:59.225314 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-54c7be84-a538-4d2b-912e-a973e44ed194 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:59.225812 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-54c7be84-a538-4d2b-912e-a973e44ed194 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:59.231219 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-54c7be84-a538-4d2b-912e-a973e44ed194 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:59.231702 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-54c7be84-a538-4d2b-912e-a973e44ed194 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:59.232441 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-54c7be84-a538-4d2b-912e-a973e44ed194 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:59.233141 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-54c7be84-a538-4d2b-912e-a973e44ed194 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:59.596896 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell0:SELECT=2 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:19:59.616351 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell0:SELECT=6 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:19:59.679244 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-54c7be84-a538-4d2b-912e-a973e44ed194 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:19:59.721104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-54c7be84-a538-4d2b-912e-a973e44ed194 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1522 microversion: 2.1 time: 0.515323 Oct 26 11:19:59.739333 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 111/232] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:59 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1522 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:19:59.749639 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-5af19624-1ffc-4c52-9d22-44a1502cd5fb tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:19:59.751039 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-5af19624-1ffc-4c52-9d22-44a1502cd5fb tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: 01c8875e-d428-4653-8654-4ce0d4893ce2] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:19:59.762610 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:19:59.764507 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5af19624-1ffc-4c52-9d22-44a1502cd5fb tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:59.765925 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5af19624-1ffc-4c52-9d22-44a1502cd5fb tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:59.766574 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5af19624-1ffc-4c52-9d22-44a1502cd5fb tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:19:59.767787 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5af19624-1ffc-4c52-9d22-44a1502cd5fb tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:19:59.768578 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5af19624-1ffc-4c52-9d22-44a1502cd5fb tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:19:59.769450 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5af19624-1ffc-4c52-9d22-44a1502cd5fb tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:00.470771 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-5af19624-1ffc-4c52-9d22-44a1502cd5fb tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:00.483802 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-5af19624-1ffc-4c52-9d22-44a1502cd5fb tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2" status: 200 len: 1313 microversion: 2.1 time: 0.751377 Oct 26 11:20:00.484392 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 122/233] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:19:59 2022] GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2 => generated 1313 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:00.748101 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-4a57ac47-0bbe-400b-a7d3-9c2d983d8b42 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:00.751885 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-4a57ac47-0bbe-400b-a7d3-9c2d983d8b42 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:00.760648 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4a57ac47-0bbe-400b-a7d3-9c2d983d8b42 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:00.763974 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4a57ac47-0bbe-400b-a7d3-9c2d983d8b42 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:00.765109 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4a57ac47-0bbe-400b-a7d3-9c2d983d8b42 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:00.767495 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4a57ac47-0bbe-400b-a7d3-9c2d983d8b42 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:00.768792 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4a57ac47-0bbe-400b-a7d3-9c2d983d8b42 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:00.770001 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4a57ac47-0bbe-400b-a7d3-9c2d983d8b42 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:00.939641 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-4a57ac47-0bbe-400b-a7d3-9c2d983d8b42 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:00.958326 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-4a57ac47-0bbe-400b-a7d3-9c2d983d8b42 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1522 microversion: 2.1 time: 0.215255 Oct 26 11:20:00.960545 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 112/234] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:00 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:01.509213 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-0824975c-a5b9-41ed-a8bb-33ff0dbf2704 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:01.510503 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-0824975c-a5b9-41ed-a8bb-33ff0dbf2704 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: 01c8875e-d428-4653-8654-4ce0d4893ce2] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:01.514040 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell0:SELECT=8 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:20:01.523036 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0824975c-a5b9-41ed-a8bb-33ff0dbf2704 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:01.525347 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0824975c-a5b9-41ed-a8bb-33ff0dbf2704 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:01.525902 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0824975c-a5b9-41ed-a8bb-33ff0dbf2704 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:01.527215 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0824975c-a5b9-41ed-a8bb-33ff0dbf2704 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:01.528826 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0824975c-a5b9-41ed-a8bb-33ff0dbf2704 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:01.529465 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0824975c-a5b9-41ed-a8bb-33ff0dbf2704 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:01.863715 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-0824975c-a5b9-41ed-a8bb-33ff0dbf2704 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:01.874607 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-0824975c-a5b9-41ed-a8bb-33ff0dbf2704 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2" status: 200 len: 1313 microversion: 2.1 time: 0.370973 Oct 26 11:20:01.875224 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 123/235] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:01 2022] GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2 => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:01.991070 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-ea46f867-bb9e-4e6d-9769-1edea53c39ba tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:01.991599 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-ea46f867-bb9e-4e6d-9769-1edea53c39ba tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:02.002515 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ea46f867-bb9e-4e6d-9769-1edea53c39ba tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:02.004547 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ea46f867-bb9e-4e6d-9769-1edea53c39ba tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:02.005030 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ea46f867-bb9e-4e6d-9769-1edea53c39ba tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:02.005820 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ea46f867-bb9e-4e6d-9769-1edea53c39ba tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:02.006307 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ea46f867-bb9e-4e6d-9769-1edea53c39ba tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:02.008788 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ea46f867-bb9e-4e6d-9769-1edea53c39ba tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:02.190269 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-ea46f867-bb9e-4e6d-9769-1edea53c39ba tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:02.200352 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-ea46f867-bb9e-4e6d-9769-1edea53c39ba tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1522 microversion: 2.1 time: 0.213470 Oct 26 11:20:02.200352 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 113/236] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:01 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:02.906193 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-fc1eeb20-ad65-46a8-9e05-686e17e5d366 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:02.910135 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-fc1eeb20-ad65-46a8-9e05-686e17e5d366 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: 01c8875e-d428-4653-8654-4ce0d4893ce2] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:02.918939 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fc1eeb20-ad65-46a8-9e05-686e17e5d366 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:02.919563 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fc1eeb20-ad65-46a8-9e05-686e17e5d366 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:02.920244 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fc1eeb20-ad65-46a8-9e05-686e17e5d366 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:02.921175 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fc1eeb20-ad65-46a8-9e05-686e17e5d366 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:02.921826 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fc1eeb20-ad65-46a8-9e05-686e17e5d366 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:02.922447 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fc1eeb20-ad65-46a8-9e05-686e17e5d366 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:03.150541 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-fc1eeb20-ad65-46a8-9e05-686e17e5d366 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:03.165534 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-fc1eeb20-ad65-46a8-9e05-686e17e5d366 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2" status: 200 len: 1313 microversion: 2.1 time: 0.271315 Oct 26 11:20:03.166057 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 124/237] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:02 2022] GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2 => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:03.228025 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a20c77b9-c2e3-444f-aa1f-826ee38e305d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:03.229556 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-a20c77b9-c2e3-444f-aa1f-826ee38e305d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:03.238481 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a20c77b9-c2e3-444f-aa1f-826ee38e305d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:03.239433 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a20c77b9-c2e3-444f-aa1f-826ee38e305d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:03.240201 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a20c77b9-c2e3-444f-aa1f-826ee38e305d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:03.241440 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a20c77b9-c2e3-444f-aa1f-826ee38e305d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:03.242253 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a20c77b9-c2e3-444f-aa1f-826ee38e305d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:03.243021 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a20c77b9-c2e3-444f-aa1f-826ee38e305d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:03.313443 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-f38abc1d-9ec4-42ff-9bea-ba0366ef6f87 req-b16f378a-e7d3-4f51-9941-642a199ea447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01c8875e-d428-4653-8654-4ce0d4893ce2", "name": "network-vif-plugged", "status": "completed", "tag": "61c4a6a4-90ef-4263-98fc-44897522cba0"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:20:03.343132 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-f38abc1d-9ec4-42ff-9bea-ba0366ef6f87 req-b16f378a-e7d3-4f51-9941-642a199ea447 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:03.343641 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-f38abc1d-9ec4-42ff-9bea-ba0366ef6f87 req-b16f378a-e7d3-4f51-9941-642a199ea447 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:03.345645 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-f38abc1d-9ec4-42ff-9bea-ba0366ef6f87 req-b16f378a-e7d3-4f51-9941-642a199ea447 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:03.377085 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-f38abc1d-9ec4-42ff-9bea-ba0366ef6f87 req-b16f378a-e7d3-4f51-9941-642a199ea447 service nova] Creating event network-vif-plugged:61c4a6a4-90ef-4263-98fc-44897522cba0 for instance 01c8875e-d428-4653-8654-4ce0d4893ce2 on hv-cinder-81558 Oct 26 11:20:03.389526 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-f38abc1d-9ec4-42ff-9bea-ba0366ef6f87 req-b16f378a-e7d3-4f51-9941-642a199ea447 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084138 Oct 26 11:20:03.390153 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 125/238] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:20:03.535164 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-a20c77b9-c2e3-444f-aa1f-826ee38e305d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:03.545301 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-a20c77b9-c2e3-444f-aa1f-826ee38e305d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1522 microversion: 2.1 time: 0.323671 Oct 26 11:20:03.546704 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 114/239] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:03 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:04.149601 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-414879fa-5e68-4639-ab37-e049d92f86c4 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Action: 'create', calling method: .version_select at 0x7f6b939aae50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1078387089", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0GBgqRWkIa48eiu5HzKBKd/6CH14HVlWGbYosjRYiQzPx2mPnNAHkvjuiUC/L1mjFhkz9oyS1kwXM8Y1H9KEw36cV0dWEVu/LbMVe3y/CRlzRTH//4qzbvuNiRUpFAmw=="}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:20:04.172323 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-414879fa-5e68-4639-ab37-e049d92f86c4 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Getting quotas for project e378bfab9d91492e81320139fed867c6. Resources: {'key_pairs'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:20:04.176467 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-414879fa-5e68-4639-ab37-e049d92f86c4 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Getting quotas for user 1f737b4d0531425cbc803fcd15a3ea1f and project e378bfab9d91492e81320139fed867c6. Resources: {'key_pairs'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:20:04.191421 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-6fe59078-c3e6-4f1e-8751-9d521a847326 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:04.192002 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-6fe59078-c3e6-4f1e-8751-9d521a847326 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: 01c8875e-d428-4653-8654-4ce0d4893ce2] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:04.198045 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6fe59078-c3e6-4f1e-8751-9d521a847326 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:04.199101 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6fe59078-c3e6-4f1e-8751-9d521a847326 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:04.199546 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6fe59078-c3e6-4f1e-8751-9d521a847326 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:04.200384 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6fe59078-c3e6-4f1e-8751-9d521a847326 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:04.200731 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6fe59078-c3e6-4f1e-8751-9d521a847326 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:04.201244 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6fe59078-c3e6-4f1e-8751-9d521a847326 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:04.220198 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:20:04.309208 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-414879fa-5e68-4639-ab37-e049d92f86c4 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.358566 Oct 26 11:20:04.309868 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 126/240] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Oct 26 11:20:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:20:04.384474 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-6fe59078-c3e6-4f1e-8751-9d521a847326 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:04.393868 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-6fe59078-c3e6-4f1e-8751-9d521a847326 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2" status: 200 len: 1313 microversion: 2.1 time: 0.206164 Oct 26 11:20:04.395743 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 115/241] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:04 2022] GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:20:04.570296 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-fce2533a-870f-43ff-85c7-75dd645b2b28 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:04.571343 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-fce2533a-870f-43ff-85c7-75dd645b2b28 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:04.579147 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fce2533a-870f-43ff-85c7-75dd645b2b28 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:04.579645 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fce2533a-870f-43ff-85c7-75dd645b2b28 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:04.580338 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fce2533a-870f-43ff-85c7-75dd645b2b28 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:04.581110 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fce2533a-870f-43ff-85c7-75dd645b2b28 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:04.581895 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fce2533a-870f-43ff-85c7-75dd645b2b28 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:04.582438 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fce2533a-870f-43ff-85c7-75dd645b2b28 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:04.953227 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-fce2533a-870f-43ff-85c7-75dd645b2b28 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:04.961672 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-fce2533a-870f-43ff-85c7-75dd645b2b28 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1502 microversion: 2.1 time: 0.395538 Oct 26 11:20:04.962574 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 127/242] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:04 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1502 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:04.987658 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-d37e0c13-b9bb-48e4-886d-a7ca8ab25440 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e02dd700-f1f8-46fb-86dd-90613a7d93f0"}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:20:04.991067 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-d37e0c13-b9bb-48e4-886d-a7ca8ab25440 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:04.996847 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d37e0c13-b9bb-48e4-886d-a7ca8ab25440 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:04.997448 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d37e0c13-b9bb-48e4-886d-a7ca8ab25440 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:04.997894 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d37e0c13-b9bb-48e4-886d-a7ca8ab25440 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:04.998595 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d37e0c13-b9bb-48e4-886d-a7ca8ab25440 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:04.999080 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d37e0c13-b9bb-48e4-886d-a7ca8ab25440 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:04.999502 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d37e0c13-b9bb-48e4-886d-a7ca8ab25440 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:05.027192 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.wsgi [None req-d37e0c13-b9bb-48e4-886d-a7ca8ab25440 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] HTTP exception thrown: Cannot 'attach_volume' instance f2f70dba-88ab-42ae-ace7-b95eeac5fcfc while it is in vm_state rescued Oct 26 11:20:05.029507 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-d37e0c13-b9bb-48e4-886d-a7ca8ab25440 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Request method failure captured: Oct 26 11:20:05.029507 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: request: POST /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc/os-volume_attachments HTTP/1.1 Oct 26 11:20:05.029507 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept: application/json Oct 26 11:20:05.029507 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept-Encoding: identity Oct 26 11:20:05.029507 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Connection: close Oct 26 11:20:05.029507 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Length: 74 Oct 26 11:20:05.029507 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Type: application/json Oct 26 11:20:05.029507 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Host: 10.222.0.42 Oct 26 11:20:05.029507 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Openstack-System-Scope: None Oct 26 11:20:05.029507 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: User-Agent: python-urllib3/1.26.12 Oct 26 11:20:05.029507 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Auth-Token: gAAAAABjWRd40WLM7XlbrGPbRw18F96uIOfpp8NDITvfojHp3EyOTvndi67r1Fha0TOXdoTqce01i5ZheMOxUzOr8ymSH94zV3s0kkFIS65f_eWJ6teUfzHgs74JxT0RZTqA8nleV0r2Q_qChfss6AyzzJ4qh4wmZHWc0a-DEdFXeuuJ2u8f3Og Oct 26 11:20:05.029507 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Id: None Oct 26 11:20:05.029507 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Name: None Oct 26 11:20:05.029507 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Identity-Status: Confirmed Oct 26 11:20:05.029507 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Is-Admin-Project: True Oct 26 11:20:05.029507 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Id: default Oct 26 11:20:05.029507 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Name: Default Oct 26 11:20:05.029507 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Id: 9d9d2ce62fb74bdb8de53bc06b1a999d Oct 26 11:20:05.029507 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1384722553 Oct 26 11:20:05.029507 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Role: member,reader Oct 26 11:20:05.029507 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Roles: member,reader Oct 26 11:20:05.030705 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d9d2ce62fb74bdb8de53bc06b1a999d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d9d2ce62fb74bdb8de53bc06b1a999d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d9d2ce62fb74bdb8de53bc06b1a999d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d9d2ce62fb74bdb8de53bc06b1a999d"}]}] Oct 26 11:20:05.030705 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1384722553 Oct 26 11:20:05.030705 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Id: 9d9d2ce62fb74bdb8de53bc06b1a999d Oct 26 11:20:05.030705 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1384722553 Oct 26 11:20:05.030705 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User: tempest-ServerRescueNegativeTestJSON-1384722553-project Oct 26 11:20:05.030705 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Id: default Oct 26 11:20:05.030705 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Name: Default Oct 26 11:20:05.030705 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Id: ff0c5f8521534fc1a0a9c5ea28fbaac1 Oct 26 11:20:05.030705 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1384722553-project Oct 26 11:20:05.030705 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Oct 26 11:20:05.030705 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {"volumeAttachment": {"volumeId": "e02dd700-f1f8-46fb-86dd-90613a7d93f0"}} Oct 26 11:20:05.030705 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: method: > Oct 26 11:20:05.031429 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: exception: Cannot 'attach_volume' instance f2f70dba-88ab-42ae-ace7-b95eeac5fcfc while it is in vm_state rescued Oct 26 11:20:05.031429 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: action_args: {'server_id': 'f2f70dba-88ab-42ae-ace7-b95eeac5fcfc', 'body': {'volumeAttachment': {'volumeId': 'e02dd700-f1f8-46fb-86dd-90613a7d93f0'}}} Oct 26 11:20:05.031429 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:20:05.031429 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:20:05.031429 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 26 11:20:05.031429 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 26 11:20:05.031429 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 11:20:05.031429 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 11:20:05.031429 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 26 11:20:05.031429 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 26 11:20:05.031429 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f2f70dba-88ab-42ae-ace7-b95eeac5fcfc in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 26 11:20:05.031429 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:20:05.031429 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:20:05.031429 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:20:05.031429 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:20:05.031429 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:20:05.031429 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:20:05.031429 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:20:05.031429 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:20:05.032846 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:20:05.032846 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:20:05.032846 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 11:20:05.032846 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 11:20:05.032846 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 11:20:05.032846 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 11:20:05.032846 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 11:20:05.032846 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 11:20:05.032846 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 26 11:20:05.032846 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 26 11:20:05.032846 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 26 11:20:05.032846 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 11:20:05.032846 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f2f70dba-88ab-42ae-ace7-b95eeac5fcfc while it is in vm_state rescued Oct 26 11:20:05.032846 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:20:05.032846 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:20:05.032846 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:20:05.032846 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:20:05.032846 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:20:05.032846 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:20:05.033876 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:20:05.033876 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:20:05.033876 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f2f70dba-88ab-42ae-ace7-b95eeac5fcfc while it is in vm_state rescued Oct 26 11:20:05.033876 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:20:05.033876 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-d37e0c13-b9bb-48e4-886d-a7ca8ab25440 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Returning 409 to user: Cannot 'attach_volume' instance f2f70dba-88ab-42ae-ace7-b95eeac5fcfc while it is in vm_state rescued {{(pid=119305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:20:05.033876 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-d37e0c13-b9bb-48e4-886d-a7ca8ab25440 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "POST /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.049355 Oct 26 11:20:05.033876 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 116/243] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Oct 26 11:20:04 2022] POST /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 11:20:05.040821 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-def3816b-70f3-43ad-9cfd-bbbd9f6fe90f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:20:05.041435 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-def3816b-70f3-43ad-9cfd-bbbd9f6fe90f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:05.048297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-def3816b-70f3-43ad-9cfd-bbbd9f6fe90f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:05.048795 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-def3816b-70f3-43ad-9cfd-bbbd9f6fe90f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:05.055874 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-def3816b-70f3-43ad-9cfd-bbbd9f6fe90f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:05.055874 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-def3816b-70f3-43ad-9cfd-bbbd9f6fe90f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:05.055874 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-def3816b-70f3-43ad-9cfd-bbbd9f6fe90f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:05.055874 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-def3816b-70f3-43ad-9cfd-bbbd9f6fe90f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:05.069726 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=100 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:20:05.334458 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-def3816b-70f3-43ad-9cfd-bbbd9f6fe90f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "POST /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc/action" status: 202 len: 0 microversion: 2.1 time: 0.297769 Oct 26 11:20:05.335146 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 128/244] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Oct 26 11:20:05 2022] POST /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 11:20:05.345292 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-1c785cff-e291-4ea1-ac25-ab4fc70dbf31 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:05.346023 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-1c785cff-e291-4ea1-ac25-ab4fc70dbf31 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:05.354041 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1c785cff-e291-4ea1-ac25-ab4fc70dbf31 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:05.354625 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1c785cff-e291-4ea1-ac25-ab4fc70dbf31 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:05.355290 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1c785cff-e291-4ea1-ac25-ab4fc70dbf31 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:05.356149 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1c785cff-e291-4ea1-ac25-ab4fc70dbf31 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:05.356621 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1c785cff-e291-4ea1-ac25-ab4fc70dbf31 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:05.357161 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1c785cff-e291-4ea1-ac25-ab4fc70dbf31 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:05.418292 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-3b26b937-ada8-40ba-a5cf-0b4feca12724 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:05.419352 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-3b26b937-ada8-40ba-a5cf-0b4feca12724 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: 01c8875e-d428-4653-8654-4ce0d4893ce2] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:05.428962 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3b26b937-ada8-40ba-a5cf-0b4feca12724 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:05.429469 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3b26b937-ada8-40ba-a5cf-0b4feca12724 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:05.430308 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3b26b937-ada8-40ba-a5cf-0b4feca12724 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:05.430653 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3b26b937-ada8-40ba-a5cf-0b4feca12724 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:05.433645 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3b26b937-ada8-40ba-a5cf-0b4feca12724 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:05.434092 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3b26b937-ada8-40ba-a5cf-0b4feca12724 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:05.509621 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-1c785cff-e291-4ea1-ac25-ab4fc70dbf31 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:05.519284 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-1c785cff-e291-4ea1-ac25-ab4fc70dbf31 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1510 microversion: 2.1 time: 0.178300 Oct 26 11:20:05.520422 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 117/245] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:05 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1510 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:05.638923 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-3b26b937-ada8-40ba-a5cf-0b4feca12724 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:05.651456 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-3b26b937-ada8-40ba-a5cf-0b4feca12724 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2" status: 200 len: 1313 microversion: 2.1 time: 0.237406 Oct 26 11:20:05.652442 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 129/246] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:05 2022] GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2 => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:20:06.544159 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-57f8ace3-9346-4e25-9aec-7462b8c3ad34 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:06.544769 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-57f8ace3-9346-4e25-9aec-7462b8c3ad34 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:06.551533 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-57f8ace3-9346-4e25-9aec-7462b8c3ad34 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:06.552051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-57f8ace3-9346-4e25-9aec-7462b8c3ad34 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:06.552496 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-57f8ace3-9346-4e25-9aec-7462b8c3ad34 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:06.553190 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-57f8ace3-9346-4e25-9aec-7462b8c3ad34 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:06.553647 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-57f8ace3-9346-4e25-9aec-7462b8c3ad34 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:06.556082 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-57f8ace3-9346-4e25-9aec-7462b8c3ad34 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:06.675319 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-2a882e1a-3d2a-452e-a73f-981b169b8008 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:06.676164 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-2a882e1a-3d2a-452e-a73f-981b169b8008 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: 01c8875e-d428-4653-8654-4ce0d4893ce2] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:06.682935 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2a882e1a-3d2a-452e-a73f-981b169b8008 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:06.683415 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2a882e1a-3d2a-452e-a73f-981b169b8008 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:06.683842 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2a882e1a-3d2a-452e-a73f-981b169b8008 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:06.684574 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2a882e1a-3d2a-452e-a73f-981b169b8008 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:06.685027 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2a882e1a-3d2a-452e-a73f-981b169b8008 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:06.685446 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2a882e1a-3d2a-452e-a73f-981b169b8008 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:06.774024 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-57f8ace3-9346-4e25-9aec-7462b8c3ad34 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:06.789781 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-57f8ace3-9346-4e25-9aec-7462b8c3ad34 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1510 microversion: 2.1 time: 0.250594 Oct 26 11:20:06.802964 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 118/247] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:06 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1510 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:06.835821 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-2a882e1a-3d2a-452e-a73f-981b169b8008 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:06.844388 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-2a882e1a-3d2a-452e-a73f-981b169b8008 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2" status: 200 len: 1313 microversion: 2.1 time: 0.172835 Oct 26 11:20:06.844969 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 130/248] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:06 2022] GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:20:07.816493 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-fca0b717-c455-428d-9864-39f77f091ffc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:07.817714 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-fca0b717-c455-428d-9864-39f77f091ffc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:07.836612 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fca0b717-c455-428d-9864-39f77f091ffc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:07.837234 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fca0b717-c455-428d-9864-39f77f091ffc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:07.837773 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fca0b717-c455-428d-9864-39f77f091ffc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:07.838415 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fca0b717-c455-428d-9864-39f77f091ffc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:07.838909 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fca0b717-c455-428d-9864-39f77f091ffc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:07.842769 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fca0b717-c455-428d-9864-39f77f091ffc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:07.868638 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-082ccb70-d846-40f9-b000-50ebb9eee460 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:07.869872 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-082ccb70-d846-40f9-b000-50ebb9eee460 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: 01c8875e-d428-4653-8654-4ce0d4893ce2] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:07.878992 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-082ccb70-d846-40f9-b000-50ebb9eee460 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:07.881531 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-082ccb70-d846-40f9-b000-50ebb9eee460 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:07.882146 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-082ccb70-d846-40f9-b000-50ebb9eee460 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:07.883056 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-082ccb70-d846-40f9-b000-50ebb9eee460 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:07.886982 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-082ccb70-d846-40f9-b000-50ebb9eee460 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:07.891817 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-082ccb70-d846-40f9-b000-50ebb9eee460 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:08.109353 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-082ccb70-d846-40f9-b000-50ebb9eee460 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:08.119660 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-082ccb70-d846-40f9-b000-50ebb9eee460 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2" status: 200 len: 1498 microversion: 2.1 time: 0.254763 Oct 26 11:20:08.127933 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 131/249] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:07 2022] GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2 => generated 1498 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:20:08.271676 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-fca0b717-c455-428d-9864-39f77f091ffc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:08.282543 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-fca0b717-c455-428d-9864-39f77f091ffc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1510 microversion: 2.1 time: 0.470387 Oct 26 11:20:08.283192 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 119/250] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:07 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1510 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:09.308992 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-4769e494-20cb-48b2-8109-e8fc7b3f3e46 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:09.309599 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-4769e494-20cb-48b2-8109-e8fc7b3f3e46 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:09.316088 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4769e494-20cb-48b2-8109-e8fc7b3f3e46 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:09.316571 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4769e494-20cb-48b2-8109-e8fc7b3f3e46 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:09.316999 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4769e494-20cb-48b2-8109-e8fc7b3f3e46 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:09.317708 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4769e494-20cb-48b2-8109-e8fc7b3f3e46 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:09.318163 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4769e494-20cb-48b2-8109-e8fc7b3f3e46 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:09.318757 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4769e494-20cb-48b2-8109-e8fc7b3f3e46 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:09.487338 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-4769e494-20cb-48b2-8109-e8fc7b3f3e46 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:09.495374 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-4769e494-20cb-48b2-8109-e8fc7b3f3e46 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1510 microversion: 2.1 time: 0.190818 Oct 26 11:20:09.496365 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 132/251] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:09 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1510 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:10.518195 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-7ed28341-5b80-4f32-8f9e-f4a11eee1abc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:10.518711 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-7ed28341-5b80-4f32-8f9e-f4a11eee1abc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:10.525310 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7ed28341-5b80-4f32-8f9e-f4a11eee1abc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:10.525897 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7ed28341-5b80-4f32-8f9e-f4a11eee1abc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:10.526335 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7ed28341-5b80-4f32-8f9e-f4a11eee1abc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:10.527061 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7ed28341-5b80-4f32-8f9e-f4a11eee1abc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:10.527517 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7ed28341-5b80-4f32-8f9e-f4a11eee1abc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:10.527948 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7ed28341-5b80-4f32-8f9e-f4a11eee1abc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:10.661344 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-7ed28341-5b80-4f32-8f9e-f4a11eee1abc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:10.669624 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-7ed28341-5b80-4f32-8f9e-f4a11eee1abc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1510 microversion: 2.1 time: 0.155391 Oct 26 11:20:10.670349 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 120/252] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:10 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:11.692507 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-4db7b802-0b7d-4329-9b27-7286abd0f084 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:11.695849 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-4db7b802-0b7d-4329-9b27-7286abd0f084 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:11.702540 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4db7b802-0b7d-4329-9b27-7286abd0f084 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:11.703203 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4db7b802-0b7d-4329-9b27-7286abd0f084 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:11.703722 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4db7b802-0b7d-4329-9b27-7286abd0f084 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:11.704474 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4db7b802-0b7d-4329-9b27-7286abd0f084 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:11.704993 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4db7b802-0b7d-4329-9b27-7286abd0f084 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:11.705481 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4db7b802-0b7d-4329-9b27-7286abd0f084 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:11.857974 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-4db7b802-0b7d-4329-9b27-7286abd0f084 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:11.865642 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-4db7b802-0b7d-4329-9b27-7286abd0f084 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1510 microversion: 2.1 time: 0.177191 Oct 26 11:20:11.866292 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 133/253] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:11 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1510 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:12.890027 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-3f284908-586f-4e2e-8d8b-21f4cdfacd13 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:12.890632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-3f284908-586f-4e2e-8d8b-21f4cdfacd13 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:12.893116 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:20:12.897753 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3f284908-586f-4e2e-8d8b-21f4cdfacd13 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:12.898238 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3f284908-586f-4e2e-8d8b-21f4cdfacd13 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:12.898674 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3f284908-586f-4e2e-8d8b-21f4cdfacd13 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:12.899502 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3f284908-586f-4e2e-8d8b-21f4cdfacd13 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:12.899959 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3f284908-586f-4e2e-8d8b-21f4cdfacd13 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:12.904891 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3f284908-586f-4e2e-8d8b-21f4cdfacd13 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:13.029285 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-3f284908-586f-4e2e-8d8b-21f4cdfacd13 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:13.037029 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-3f284908-586f-4e2e-8d8b-21f4cdfacd13 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1510 microversion: 2.1 time: 0.151469 Oct 26 11:20:13.037598 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 121/254] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:12 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:14.061299 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-c00b8f15-1635-4960-a27a-e4ac4a882d18 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:14.061882 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-c00b8f15-1635-4960-a27a-e4ac4a882d18 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:14.067910 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c00b8f15-1635-4960-a27a-e4ac4a882d18 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:14.068387 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c00b8f15-1635-4960-a27a-e4ac4a882d18 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:14.068816 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c00b8f15-1635-4960-a27a-e4ac4a882d18 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:14.069495 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c00b8f15-1635-4960-a27a-e4ac4a882d18 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:14.069941 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c00b8f15-1635-4960-a27a-e4ac4a882d18 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:14.070360 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c00b8f15-1635-4960-a27a-e4ac4a882d18 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:14.185019 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell0:SELECT=4 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:20:14.200769 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-c00b8f15-1635-4960-a27a-e4ac4a882d18 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:14.205861 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-c00b8f15-1635-4960-a27a-e4ac4a882d18 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1510 microversion: 2.1 time: 0.148978 Oct 26 11:20:14.206450 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 134/255] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:14 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:15.229452 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-bb1ef24b-4efa-42c9-bb7f-637f979f99e4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:15.230158 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-bb1ef24b-4efa-42c9-bb7f-637f979f99e4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:15.237107 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bb1ef24b-4efa-42c9-bb7f-637f979f99e4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:15.237580 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bb1ef24b-4efa-42c9-bb7f-637f979f99e4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:15.238013 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bb1ef24b-4efa-42c9-bb7f-637f979f99e4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:15.238706 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bb1ef24b-4efa-42c9-bb7f-637f979f99e4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:15.239381 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bb1ef24b-4efa-42c9-bb7f-637f979f99e4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:15.239803 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bb1ef24b-4efa-42c9-bb7f-637f979f99e4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:15.372824 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-bb1ef24b-4efa-42c9-bb7f-637f979f99e4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:15.380588 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-bb1ef24b-4efa-42c9-bb7f-637f979f99e4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1510 microversion: 2.1 time: 0.155171 Oct 26 11:20:15.381158 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 122/256] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:15 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:16.404711 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-65769a28-43a6-4031-90cc-5400d6e0b91e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:16.405333 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-65769a28-43a6-4031-90cc-5400d6e0b91e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:16.411525 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-65769a28-43a6-4031-90cc-5400d6e0b91e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:16.412009 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-65769a28-43a6-4031-90cc-5400d6e0b91e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:16.412436 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-65769a28-43a6-4031-90cc-5400d6e0b91e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:16.413129 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-65769a28-43a6-4031-90cc-5400d6e0b91e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:16.413603 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-65769a28-43a6-4031-90cc-5400d6e0b91e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:16.414021 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-65769a28-43a6-4031-90cc-5400d6e0b91e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:16.545958 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-65769a28-43a6-4031-90cc-5400d6e0b91e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:16.553557 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-65769a28-43a6-4031-90cc-5400d6e0b91e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1510 microversion: 2.1 time: 0.153317 Oct 26 11:20:16.554111 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 135/257] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:16 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:17.577756 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-8cac2613-56c5-41c1-8d0b-ef5fee35cab5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:17.578382 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-8cac2613-56c5-41c1-8d0b-ef5fee35cab5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:17.584737 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8cac2613-56c5-41c1-8d0b-ef5fee35cab5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:17.585216 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8cac2613-56c5-41c1-8d0b-ef5fee35cab5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:17.585649 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8cac2613-56c5-41c1-8d0b-ef5fee35cab5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:17.586334 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8cac2613-56c5-41c1-8d0b-ef5fee35cab5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:17.586782 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8cac2613-56c5-41c1-8d0b-ef5fee35cab5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:17.587229 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8cac2613-56c5-41c1-8d0b-ef5fee35cab5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:17.717113 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-8cac2613-56c5-41c1-8d0b-ef5fee35cab5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:17.725134 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-8cac2613-56c5-41c1-8d0b-ef5fee35cab5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1510 microversion: 2.1 time: 0.151840 Oct 26 11:20:17.725712 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 123/258] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:17 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:18.748362 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-b6468ca3-b267-42ae-90a2-184f82243e2a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:18.748967 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-b6468ca3-b267-42ae-90a2-184f82243e2a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:18.755232 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b6468ca3-b267-42ae-90a2-184f82243e2a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:18.755710 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b6468ca3-b267-42ae-90a2-184f82243e2a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:18.756140 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b6468ca3-b267-42ae-90a2-184f82243e2a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:18.756816 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b6468ca3-b267-42ae-90a2-184f82243e2a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:18.757259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b6468ca3-b267-42ae-90a2-184f82243e2a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:18.757678 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b6468ca3-b267-42ae-90a2-184f82243e2a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:18.885496 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-b6468ca3-b267-42ae-90a2-184f82243e2a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:18.893586 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-b6468ca3-b267-42ae-90a2-184f82243e2a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1510 microversion: 2.1 time: 0.149213 Oct 26 11:20:18.894153 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 136/259] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:18 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:19.918363 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-534a7a6e-4f7b-46ca-ace6-40b06ae7f66b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:19.919030 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-534a7a6e-4f7b-46ca-ace6-40b06ae7f66b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:19.925882 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-534a7a6e-4f7b-46ca-ace6-40b06ae7f66b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:19.926361 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-534a7a6e-4f7b-46ca-ace6-40b06ae7f66b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:19.926793 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-534a7a6e-4f7b-46ca-ace6-40b06ae7f66b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:19.927496 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-534a7a6e-4f7b-46ca-ace6-40b06ae7f66b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:19.927943 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-534a7a6e-4f7b-46ca-ace6-40b06ae7f66b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:19.928362 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-534a7a6e-4f7b-46ca-ace6-40b06ae7f66b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:20.055263 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-534a7a6e-4f7b-46ca-ace6-40b06ae7f66b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:20.063115 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-534a7a6e-4f7b-46ca-ace6-40b06ae7f66b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1510 microversion: 2.1 time: 0.149436 Oct 26 11:20:20.063678 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 124/260] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:19 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:21.085567 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-a7a9b8b2-22a3-4666-be59-3edd095f9f4b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:21.086221 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-a7a9b8b2-22a3-4666-be59-3edd095f9f4b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:21.092252 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a7a9b8b2-22a3-4666-be59-3edd095f9f4b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:21.092747 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a7a9b8b2-22a3-4666-be59-3edd095f9f4b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:21.093183 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a7a9b8b2-22a3-4666-be59-3edd095f9f4b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:21.093874 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a7a9b8b2-22a3-4666-be59-3edd095f9f4b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:21.094334 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a7a9b8b2-22a3-4666-be59-3edd095f9f4b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:21.094757 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a7a9b8b2-22a3-4666-be59-3edd095f9f4b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:21.225269 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-a7a9b8b2-22a3-4666-be59-3edd095f9f4b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:21.233717 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-a7a9b8b2-22a3-4666-be59-3edd095f9f4b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1510 microversion: 2.1 time: 0.152072 Oct 26 11:20:21.234289 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 137/261] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:21 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:21.821198 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-1c8c5524-c56e-44c3-95a4-35449eb76beb tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:21.822061 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-1c8c5524-c56e-44c3-95a4-35449eb76beb tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: 01c8875e-d428-4653-8654-4ce0d4893ce2] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:21.829840 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1c8c5524-c56e-44c3-95a4-35449eb76beb tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:21.830328 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1c8c5524-c56e-44c3-95a4-35449eb76beb tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:21.830803 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1c8c5524-c56e-44c3-95a4-35449eb76beb tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:21.831567 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1c8c5524-c56e-44c3-95a4-35449eb76beb tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:21.832022 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1c8c5524-c56e-44c3-95a4-35449eb76beb tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:21.832446 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1c8c5524-c56e-44c3-95a4-35449eb76beb tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:21.857958 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-1c8c5524-c56e-44c3-95a4-35449eb76beb tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: 01c8875e-d428-4653-8654-4ce0d4893ce2] Going to try to terminate instance {{(pid=119305) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 11:20:22.088053 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-1c8c5524-c56e-44c3-95a4-35449eb76beb tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "DELETE /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2" status: 204 len: 0 microversion: 2.1 time: 0.270774 Oct 26 11:20:22.088578 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 125/262] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Oct 26 11:20:21 2022] DELETE /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 11:20:22.096600 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-25795f6d-ad60-411f-9be0-7dd45cc9b53d tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:22.097208 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-25795f6d-ad60-411f-9be0-7dd45cc9b53d tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: 01c8875e-d428-4653-8654-4ce0d4893ce2] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:22.103061 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-25795f6d-ad60-411f-9be0-7dd45cc9b53d tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:22.103541 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-25795f6d-ad60-411f-9be0-7dd45cc9b53d tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:22.103970 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-25795f6d-ad60-411f-9be0-7dd45cc9b53d tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:22.104647 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-25795f6d-ad60-411f-9be0-7dd45cc9b53d tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:22.105092 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-25795f6d-ad60-411f-9be0-7dd45cc9b53d tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:22.105509 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-25795f6d-ad60-411f-9be0-7dd45cc9b53d tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:22.241303 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-25795f6d-ad60-411f-9be0-7dd45cc9b53d tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:22.249462 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-25795f6d-ad60-411f-9be0-7dd45cc9b53d tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2" status: 200 len: 1504 microversion: 2.1 time: 0.156646 Oct 26 11:20:22.250019 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 138/263] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:22 2022] GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:22.256776 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-300016c4-f372-430f-94a5-4d07ab5037da tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:22.257555 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-300016c4-f372-430f-94a5-4d07ab5037da tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:22.264210 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-300016c4-f372-430f-94a5-4d07ab5037da tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:22.264762 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-300016c4-f372-430f-94a5-4d07ab5037da tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:22.265265 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-300016c4-f372-430f-94a5-4d07ab5037da tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:22.266073 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-300016c4-f372-430f-94a5-4d07ab5037da tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:22.266669 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-300016c4-f372-430f-94a5-4d07ab5037da tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:22.267230 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-300016c4-f372-430f-94a5-4d07ab5037da tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:22.398205 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-300016c4-f372-430f-94a5-4d07ab5037da tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:22.405796 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-300016c4-f372-430f-94a5-4d07ab5037da tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1510 microversion: 2.1 time: 0.153110 Oct 26 11:20:22.406355 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 126/264] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:22 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:23.272453 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-ee225c87-7273-4f16-8cac-287e4545efe6 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:23.272983 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-ee225c87-7273-4f16-8cac-287e4545efe6 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: 01c8875e-d428-4653-8654-4ce0d4893ce2] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:23.278889 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ee225c87-7273-4f16-8cac-287e4545efe6 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:23.279931 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ee225c87-7273-4f16-8cac-287e4545efe6 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:23.280366 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ee225c87-7273-4f16-8cac-287e4545efe6 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:23.281055 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ee225c87-7273-4f16-8cac-287e4545efe6 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:23.281505 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ee225c87-7273-4f16-8cac-287e4545efe6 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:23.281951 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ee225c87-7273-4f16-8cac-287e4545efe6 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:23.408186 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ee225c87-7273-4f16-8cac-287e4545efe6 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:23.415846 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-ee225c87-7273-4f16-8cac-287e4545efe6 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2" status: 200 len: 1504 microversion: 2.1 time: 0.147408 Oct 26 11:20:23.416415 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 139/265] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:23 2022] GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2 => generated 1504 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:23.429402 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-e7232578-0ac4-4164-b613-ded17dac0c4a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:23.430204 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-e7232578-0ac4-4164-b613-ded17dac0c4a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:23.437438 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e7232578-0ac4-4164-b613-ded17dac0c4a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:23.438162 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e7232578-0ac4-4164-b613-ded17dac0c4a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:23.438670 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e7232578-0ac4-4164-b613-ded17dac0c4a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:23.439471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e7232578-0ac4-4164-b613-ded17dac0c4a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:23.440043 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e7232578-0ac4-4164-b613-ded17dac0c4a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:23.440529 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e7232578-0ac4-4164-b613-ded17dac0c4a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:23.578847 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-e7232578-0ac4-4164-b613-ded17dac0c4a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:23.586545 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-e7232578-0ac4-4164-b613-ded17dac0c4a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1510 microversion: 2.1 time: 0.161080 Oct 26 11:20:23.587161 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 127/266] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:23 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:24.439975 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-c92e61d3-cb72-453e-8080-b2ba81c6d215 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:24.440588 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-c92e61d3-cb72-453e-8080-b2ba81c6d215 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: 01c8875e-d428-4653-8654-4ce0d4893ce2] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:24.446763 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c92e61d3-cb72-453e-8080-b2ba81c6d215 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:24.447275 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c92e61d3-cb72-453e-8080-b2ba81c6d215 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:24.447711 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c92e61d3-cb72-453e-8080-b2ba81c6d215 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:24.448402 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c92e61d3-cb72-453e-8080-b2ba81c6d215 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:24.448851 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c92e61d3-cb72-453e-8080-b2ba81c6d215 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:24.449270 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c92e61d3-cb72-453e-8080-b2ba81c6d215 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:24.578251 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-c92e61d3-cb72-453e-8080-b2ba81c6d215 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:24.586752 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-c92e61d3-cb72-453e-8080-b2ba81c6d215 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2" status: 200 len: 1504 microversion: 2.1 time: 0.150779 Oct 26 11:20:24.587346 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 140/267] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:24 2022] GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:24.609562 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-8ea59548-add9-4d26-b7bd-1c78da91ba3d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:24.614472 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-8ea59548-add9-4d26-b7bd-1c78da91ba3d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:24.616630 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8ea59548-add9-4d26-b7bd-1c78da91ba3d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:24.617204 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8ea59548-add9-4d26-b7bd-1c78da91ba3d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:24.617641 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8ea59548-add9-4d26-b7bd-1c78da91ba3d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:24.618327 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8ea59548-add9-4d26-b7bd-1c78da91ba3d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:24.618790 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8ea59548-add9-4d26-b7bd-1c78da91ba3d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:24.619235 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8ea59548-add9-4d26-b7bd-1c78da91ba3d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:24.755406 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-8ea59548-add9-4d26-b7bd-1c78da91ba3d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:24.763158 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-8ea59548-add9-4d26-b7bd-1c78da91ba3d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1510 microversion: 2.1 time: 0.157548 Oct 26 11:20:24.763729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 128/268] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:24 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:24.957139 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-916b5b0a-be2b-40fb-9b30-ba3aeea60578 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-956018703", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2012182741", "security_groups": [{"name": "tempest-secgroup-smoke-1488296574"}], "networks": [{"uuid": "7dc53a5a-1ef2-4e2a-ad37-d04164fc5fbd"}], "block_device_mapping_v2": [{"uuid": "23be154f-8cde-42e1-a6cd-48fef6236b43", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:20:25.074351 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.network.neutron [None req-916b5b0a-be2b-40fb-9b30-ba3aeea60578 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] validate_networks() for [('7dc53a5a-1ef2-4e2a-ad37-d04164fc5fbd', None, None, None, None, None)] {{(pid=119306) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 11:20:25.438079 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-916b5b0a-be2b-40fb-9b30-ba3aeea60578 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Flavor limits 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 11:20:25.439029 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-916b5b0a-be2b-40fb-9b30-ba3aeea60578 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Image limits 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 11:20:25.439820 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-916b5b0a-be2b-40fb-9b30-ba3aeea60578 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Flavor pref 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 11:20:25.440372 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-916b5b0a-be2b-40fb-9b30-ba3aeea60578 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Image pref 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 11:20:25.441014 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-916b5b0a-be2b-40fb-9b30-ba3aeea60578 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 11:20:25.453939 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-916b5b0a-be2b-40fb-9b30-ba3aeea60578 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:25.464066 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-916b5b0a-be2b-40fb-9b30-ba3aeea60578 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:25.464066 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-916b5b0a-be2b-40fb-9b30-ba3aeea60578 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:25.464066 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-916b5b0a-be2b-40fb-9b30-ba3aeea60578 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:25.464066 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-916b5b0a-be2b-40fb-9b30-ba3aeea60578 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:25.464644 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-916b5b0a-be2b-40fb-9b30-ba3aeea60578 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:25.473695 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-916b5b0a-be2b-40fb-9b30-ba3aeea60578 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Getting quotas for project a30976e8b35f436b84dc4488dcf5acaf. Resources: {'cores', 'instances', 'ram'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:20:25.477822 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-916b5b0a-be2b-40fb-9b30-ba3aeea60578 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Getting quotas for user ce09c776cd77416091ea214b858afacd and project a30976e8b35f436b84dc4488dcf5acaf. Resources: {'cores', 'instances', 'ram'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:20:25.536140 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-916b5b0a-be2b-40fb-9b30-ba3aeea60578 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Going to run 1 instances... {{(pid=119306) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 11:20:25.538378 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-916b5b0a-be2b-40fb-9b30-ba3aeea60578 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='23be154f-8cde-42e1-a6cd-48fef6236b43',volume_size=None,volume_type=None)] {{(pid=119306) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 11:20:25.610151 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-635b03c2-2e53-494f-8bf2-682e3c3b9a71 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:25.610792 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-635b03c2-2e53-494f-8bf2-682e3c3b9a71 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: 01c8875e-d428-4653-8654-4ce0d4893ce2] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:25.617288 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-635b03c2-2e53-494f-8bf2-682e3c3b9a71 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:25.617985 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-635b03c2-2e53-494f-8bf2-682e3c3b9a71 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:25.618444 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-635b03c2-2e53-494f-8bf2-682e3c3b9a71 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:25.619159 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-635b03c2-2e53-494f-8bf2-682e3c3b9a71 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:25.619639 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-635b03c2-2e53-494f-8bf2-682e3c3b9a71 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:25.620292 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-635b03c2-2e53-494f-8bf2-682e3c3b9a71 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:25.753344 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-635b03c2-2e53-494f-8bf2-682e3c3b9a71 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:25.760886 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-635b03c2-2e53-494f-8bf2-682e3c3b9a71 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2" status: 200 len: 1504 microversion: 2.1 time: 0.155225 Oct 26 11:20:25.761449 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 129/269] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:25 2022] GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:20:25.787572 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-3b35023b-c100-4fe1-bcbe-9cfcb3a170a2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:25.788175 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-3b35023b-c100-4fe1-bcbe-9cfcb3a170a2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:25.795163 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3b35023b-c100-4fe1-bcbe-9cfcb3a170a2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:25.795803 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3b35023b-c100-4fe1-bcbe-9cfcb3a170a2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:25.796233 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3b35023b-c100-4fe1-bcbe-9cfcb3a170a2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:25.797719 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3b35023b-c100-4fe1-bcbe-9cfcb3a170a2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:25.798179 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3b35023b-c100-4fe1-bcbe-9cfcb3a170a2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:25.798604 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3b35023b-c100-4fe1-bcbe-9cfcb3a170a2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:25.933172 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-3b35023b-c100-4fe1-bcbe-9cfcb3a170a2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:25.936951 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:20:25.941407 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-3b35023b-c100-4fe1-bcbe-9cfcb3a170a2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1516 microversion: 2.1 time: 0.157585 Oct 26 11:20:25.945910 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 130/270] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:25 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:20:25.994186 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-916b5b0a-be2b-40fb-9b30-ba3aeea60578 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.041465 Oct 26 11:20:25.998868 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 141/271] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Oct 26 11:20:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 26 11:20:26.006638 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-708615a6-e5ff-4ad2-af80-492bd18ef6b4 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:26.007337 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-708615a6-e5ff-4ad2-af80-492bd18ef6b4 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:26.087134 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-708615a6-e5ff-4ad2-af80-492bd18ef6b4 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:26.094938 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-708615a6-e5ff-4ad2-af80-492bd18ef6b4 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1088 microversion: 2.1 time: 0.092373 Oct 26 11:20:26.096399 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 131/272] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:26 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1088 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:26.790046 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-dbacef55-e0b4-4834-86b9-2927bff7efa1 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:26.790669 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-dbacef55-e0b4-4834-86b9-2927bff7efa1 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: 01c8875e-d428-4653-8654-4ce0d4893ce2] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:26.797034 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dbacef55-e0b4-4834-86b9-2927bff7efa1 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:26.797813 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dbacef55-e0b4-4834-86b9-2927bff7efa1 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:26.798455 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dbacef55-e0b4-4834-86b9-2927bff7efa1 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:26.799212 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dbacef55-e0b4-4834-86b9-2927bff7efa1 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:26.799816 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dbacef55-e0b4-4834-86b9-2927bff7efa1 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:26.800552 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dbacef55-e0b4-4834-86b9-2927bff7efa1 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:26.943839 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-dbacef55-e0b4-4834-86b9-2927bff7efa1 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:26.951719 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-dbacef55-e0b4-4834-86b9-2927bff7efa1 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2" status: 200 len: 1504 microversion: 2.1 time: 0.171640 Oct 26 11:20:26.952296 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 142/273] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:26 2022] GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2 => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:27.117691 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-ce8be905-fb2f-4f45-8b8e-6f53f1128c85 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:27.118309 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-ce8be905-fb2f-4f45-8b8e-6f53f1128c85 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:27.124838 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ce8be905-fb2f-4f45-8b8e-6f53f1128c85 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:27.125833 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ce8be905-fb2f-4f45-8b8e-6f53f1128c85 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:27.126281 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ce8be905-fb2f-4f45-8b8e-6f53f1128c85 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:27.127007 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ce8be905-fb2f-4f45-8b8e-6f53f1128c85 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:27.127467 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ce8be905-fb2f-4f45-8b8e-6f53f1128c85 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:27.133094 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ce8be905-fb2f-4f45-8b8e-6f53f1128c85 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:27.216364 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-ce8be905-fb2f-4f45-8b8e-6f53f1128c85 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:27.224618 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-ce8be905-fb2f-4f45-8b8e-6f53f1128c85 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1138 microversion: 2.1 time: 0.111009 Oct 26 11:20:27.230574 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 132/274] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:27 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1138 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:27.284628 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-39a9ce19-8e7c-4ecf-8ca6-de08a2955907 req-b080725f-2112-4a13-a51e-2e8ec90fcdc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01c8875e-d428-4653-8654-4ce0d4893ce2", "name": "network-vif-deleted", "tag": "61c4a6a4-90ef-4263-98fc-44897522cba0"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:20:27.302470 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-39a9ce19-8e7c-4ecf-8ca6-de08a2955907 req-b080725f-2112-4a13-a51e-2e8ec90fcdc2 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:27.303093 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-39a9ce19-8e7c-4ecf-8ca6-de08a2955907 req-b080725f-2112-4a13-a51e-2e8ec90fcdc2 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:27.303490 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-39a9ce19-8e7c-4ecf-8ca6-de08a2955907 req-b080725f-2112-4a13-a51e-2e8ec90fcdc2 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:27.316809 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-39a9ce19-8e7c-4ecf-8ca6-de08a2955907 req-b080725f-2112-4a13-a51e-2e8ec90fcdc2 service nova] Creating event network-vif-deleted:61c4a6a4-90ef-4263-98fc-44897522cba0 for instance 01c8875e-d428-4653-8654-4ce0d4893ce2 on hv-cinder-81558 Oct 26 11:20:27.322029 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-39a9ce19-8e7c-4ecf-8ca6-de08a2955907 req-b080725f-2112-4a13-a51e-2e8ec90fcdc2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041095 Oct 26 11:20:27.326665 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 143/275] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:20:27.979881 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-4fbfd9bc-a2a1-413f-ba93-74ed5ab7a126 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:27.982920 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-4fbfd9bc-a2a1-413f-ba93-74ed5ab7a126 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: 01c8875e-d428-4653-8654-4ce0d4893ce2] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:27.988561 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4fbfd9bc-a2a1-413f-ba93-74ed5ab7a126 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:27.989188 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4fbfd9bc-a2a1-413f-ba93-74ed5ab7a126 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:27.989625 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4fbfd9bc-a2a1-413f-ba93-74ed5ab7a126 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:27.990328 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4fbfd9bc-a2a1-413f-ba93-74ed5ab7a126 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:27.990785 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4fbfd9bc-a2a1-413f-ba93-74ed5ab7a126 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:27.991231 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4fbfd9bc-a2a1-413f-ba93-74ed5ab7a126 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:28.022173 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4fbfd9bc-a2a1-413f-ba93-74ed5ab7a126 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:28.022652 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4fbfd9bc-a2a1-413f-ba93-74ed5ab7a126 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:28.023256 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4fbfd9bc-a2a1-413f-ba93-74ed5ab7a126 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:28.023699 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.objects.instance [None req-4fbfd9bc-a2a1-413f-ba93-74ed5ab7a126 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lazy-loading 'fault' on Instance uuid 01c8875e-d428-4653-8654-4ce0d4893ce2 {{(pid=119305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:20:28.072316 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-4fbfd9bc-a2a1-413f-ba93-74ed5ab7a126 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:28.080454 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-4fbfd9bc-a2a1-413f-ba93-74ed5ab7a126 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2" status: 200 len: 1303 microversion: 2.1 time: 0.108985 Oct 26 11:20:28.081097 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 133/276] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:27 2022] GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2 => generated 1303 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:28.248365 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-dd8c187f-ad98-4826-a575-c059cff0343a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:28.248980 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-dd8c187f-ad98-4826-a575-c059cff0343a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:28.255699 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dd8c187f-ad98-4826-a575-c059cff0343a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:28.256206 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dd8c187f-ad98-4826-a575-c059cff0343a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:28.256636 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dd8c187f-ad98-4826-a575-c059cff0343a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:28.257319 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dd8c187f-ad98-4826-a575-c059cff0343a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:28.257777 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dd8c187f-ad98-4826-a575-c059cff0343a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:28.258200 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dd8c187f-ad98-4826-a575-c059cff0343a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:28.323656 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-dd8c187f-ad98-4826-a575-c059cff0343a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:28.331369 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-dd8c187f-ad98-4826-a575-c059cff0343a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1186 microversion: 2.1 time: 0.087194 Oct 26 11:20:28.331946 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 144/277] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:28 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1186 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:29.106565 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-721c1641-48d5-4491-84f0-7fc34a2e39e0 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:29.107221 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-721c1641-48d5-4491-84f0-7fc34a2e39e0 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: 01c8875e-d428-4653-8654-4ce0d4893ce2] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:29.114218 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-721c1641-48d5-4491-84f0-7fc34a2e39e0 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:29.114717 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-721c1641-48d5-4491-84f0-7fc34a2e39e0 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:29.115358 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-721c1641-48d5-4491-84f0-7fc34a2e39e0 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:29.116249 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-721c1641-48d5-4491-84f0-7fc34a2e39e0 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:29.116761 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-721c1641-48d5-4491-84f0-7fc34a2e39e0 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:29.117364 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-721c1641-48d5-4491-84f0-7fc34a2e39e0 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:29.151086 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-721c1641-48d5-4491-84f0-7fc34a2e39e0 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:29.151580 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-721c1641-48d5-4491-84f0-7fc34a2e39e0 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:29.152022 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-721c1641-48d5-4491-84f0-7fc34a2e39e0 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:29.152472 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.objects.instance [None req-721c1641-48d5-4491-84f0-7fc34a2e39e0 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lazy-loading 'fault' on Instance uuid 01c8875e-d428-4653-8654-4ce0d4893ce2 {{(pid=119305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:20:29.208787 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-721c1641-48d5-4491-84f0-7fc34a2e39e0 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:29.216813 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-721c1641-48d5-4491-84f0-7fc34a2e39e0 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2" status: 200 len: 1303 microversion: 2.1 time: 0.114057 Oct 26 11:20:29.217389 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 134/278] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:29 2022] GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2 => generated 1303 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:29.353956 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-703d4fbf-f3e9-479c-8f0f-24b17363c62f tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:29.354556 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-703d4fbf-f3e9-479c-8f0f-24b17363c62f tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:29.360605 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-703d4fbf-f3e9-479c-8f0f-24b17363c62f tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:29.361135 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-703d4fbf-f3e9-479c-8f0f-24b17363c62f tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:29.370233 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-703d4fbf-f3e9-479c-8f0f-24b17363c62f tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:29.370233 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-703d4fbf-f3e9-479c-8f0f-24b17363c62f tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:29.370233 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-703d4fbf-f3e9-479c-8f0f-24b17363c62f tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:29.370233 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-703d4fbf-f3e9-479c-8f0f-24b17363c62f tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:29.382773 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:20:29.509433 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-703d4fbf-f3e9-479c-8f0f-24b17363c62f tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:29.518298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-703d4fbf-f3e9-479c-8f0f-24b17363c62f tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1272 microversion: 2.1 time: 0.168175 Oct 26 11:20:29.518922 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 145/279] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:29 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1272 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:29.793319 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-98585526-7f40-4d74-bf9d-9c8b4aac4b96 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Action: 'create', calling method: .version_select at 0x7f6b93b36dc0>, body: {"keypair": {"name": "tempest-keypair-470444218", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8sn1fe9dZzLi6k9asfa+qjvLicPzS+PXqy+3s8EbR+0Iwk2zQ5xibDAkFOCWrCZORFACJqyl08NKdi1n335gCx0Bo2cYkgaN1IQDJjwxH85N+Ip9AujlEn38YKTnOgQg=="}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:20:29.809210 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.quota [None req-98585526-7f40-4d74-bf9d-9c8b4aac4b96 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Getting quotas for project 9d9d2ce62fb74bdb8de53bc06b1a999d. Resources: {'key_pairs'} {{(pid=119305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:20:29.813389 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.quota [None req-98585526-7f40-4d74-bf9d-9c8b4aac4b96 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Getting quotas for user ff0c5f8521534fc1a0a9c5ea28fbaac1 and project 9d9d2ce62fb74bdb8de53bc06b1a999d. Resources: {'key_pairs'} {{(pid=119305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:20:29.930607 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-98585526-7f40-4d74-bf9d-9c8b4aac4b96 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.141170 Oct 26 11:20:29.938017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 135/280] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Oct 26 11:20:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:20:30.242657 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-2a773de0-759e-4a91-895d-1c36be3668d2 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:30.242657 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-2a773de0-759e-4a91-895d-1c36be3668d2 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: 01c8875e-d428-4653-8654-4ce0d4893ce2] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:30.248259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2a773de0-759e-4a91-895d-1c36be3668d2 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:30.249085 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2a773de0-759e-4a91-895d-1c36be3668d2 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:30.249530 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2a773de0-759e-4a91-895d-1c36be3668d2 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:30.250236 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2a773de0-759e-4a91-895d-1c36be3668d2 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:30.250677 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2a773de0-759e-4a91-895d-1c36be3668d2 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:30.251154 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2a773de0-759e-4a91-895d-1c36be3668d2 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:30.265366 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.wsgi [None req-2a773de0-759e-4a91-895d-1c36be3668d2 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] HTTP exception thrown: Instance 01c8875e-d428-4653-8654-4ce0d4893ce2 could not be found. Oct 26 11:20:30.267298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-2a773de0-759e-4a91-895d-1c36be3668d2 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Request method failure captured: Oct 26 11:20:30.267298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: request: GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2 HTTP/1.1 Oct 26 11:20:30.267298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept: application/json Oct 26 11:20:30.267298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept-Encoding: identity Oct 26 11:20:30.267298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Connection: close Oct 26 11:20:30.267298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Length: 0 Oct 26 11:20:30.267298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Type: application/json Oct 26 11:20:30.267298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Host: 10.222.0.42 Oct 26 11:20:30.267298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Openstack-System-Scope: None Oct 26 11:20:30.267298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: User-Agent: python-urllib3/1.26.12 Oct 26 11:20:30.267298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Auth-Token: gAAAAABjWRfRVGi25fndz9tZRdavm38qjTT7NJirS-b77jfm689_qbcAHS6SvYplIT3sko6For2ef-c1Dkzk5tUcXtd_ZjUs8XiXR2Y_0BW2KQGe8Q_nJiZ_K91eNzbcMjQBOsY_Oc-bpSkfPXAnxs82IpzXJu7iz6X4gUFqqbirf42QKfiFrBk Oct 26 11:20:30.267298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Id: None Oct 26 11:20:30.267298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Name: None Oct 26 11:20:30.267298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Identity-Status: Confirmed Oct 26 11:20:30.267298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Is-Admin-Project: True Oct 26 11:20:30.267298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Id: default Oct 26 11:20:30.267298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Name: Default Oct 26 11:20:30.267298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Id: 8576eb9289f147f2ab9ba6f1c00b3ffd Oct 26 11:20:30.267298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Name: tempest-VolumesActionsTest-2075731229 Oct 26 11:20:30.267298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Role: member,reader Oct 26 11:20:30.267298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Roles: member,reader Oct 26 11:20:30.268819 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8576eb9289f147f2ab9ba6f1c00b3ffd", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8576eb9289f147f2ab9ba6f1c00b3ffd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8576eb9289f147f2ab9ba6f1c00b3ffd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8576eb9289f147f2ab9ba6f1c00b3ffd"}]}] Oct 26 11:20:30.268819 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant: tempest-VolumesActionsTest-2075731229 Oct 26 11:20:30.268819 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Id: 8576eb9289f147f2ab9ba6f1c00b3ffd Oct 26 11:20:30.268819 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Name: tempest-VolumesActionsTest-2075731229 Oct 26 11:20:30.268819 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User: tempest-VolumesActionsTest-2075731229-project Oct 26 11:20:30.268819 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Id: default Oct 26 11:20:30.268819 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Name: Default Oct 26 11:20:30.268819 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Id: a79972df53cf4245be9c45a9b579cff9 Oct 26 11:20:30.268819 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Name: tempest-VolumesActionsTest-2075731229-project Oct 26 11:20:30.268819 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: method: > Oct 26 11:20:30.268819 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: exception: Instance 01c8875e-d428-4653-8654-4ce0d4893ce2 could not be found. Oct 26 11:20:30.268819 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: action_args: {'id': '01c8875e-d428-4653-8654-4ce0d4893ce2'} Oct 26 11:20:30.269671 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:20:30.269671 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:20:30.269671 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:20:30.269671 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:20:30.269671 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:20:30.269671 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:20:30.269671 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:20:30.269671 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:20:30.269671 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:20:30.269671 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:20:30.269671 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01c8875e-d428-4653-8654-4ce0d4893ce2 could not be found. Oct 26 11:20:30.269671 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:20:30.269671 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:20:30.269671 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:20:30.269671 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:20:30.269671 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:20:30.269671 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:20:30.269671 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:20:30.269671 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:20:30.269671 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:20:30.275080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:20:30.275080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 11:20:30.275080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 11:20:30.275080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:20:30.275080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:20:30.275080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:20:30.275080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:20:30.275080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01c8875e-d428-4653-8654-4ce0d4893ce2 could not be found. Oct 26 11:20:30.275080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:20:30.275080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:20:30.275080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:20:30.275080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:20:30.275080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:20:30.275080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:20:30.275080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:20:30.275080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:20:30.275080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01c8875e-d428-4653-8654-4ce0d4893ce2 could not be found. Oct 26 11:20:30.275080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:20:30.276143 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-2a773de0-759e-4a91-895d-1c36be3668d2 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Returning 404 to user: Instance 01c8875e-d428-4653-8654-4ce0d4893ce2 could not be found. {{(pid=119306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:20:30.276143 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-2a773de0-759e-4a91-895d-1c36be3668d2 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2" status: 404 len: 111 microversion: 2.1 time: 0.036145 Oct 26 11:20:30.276143 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 146/281] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:30 2022] GET /compute/v2.1/servers/01c8875e-d428-4653-8654-4ce0d4893ce2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:20:30.373203 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a13ad0a1-9776-494f-8668-5cc2b8e78a0a tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-229252970", "imageRef": "ed8b5733-339c-4fa7-9767-abef514cb9f2", "flavorRef": "452", "networks": [{"uuid": "75a10cc7-b501-47b5-a507-62e78a6167f4"}]}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:20:30.438720 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.network.neutron [None req-a13ad0a1-9776-494f-8668-5cc2b8e78a0a tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] validate_networks() for [('75a10cc7-b501-47b5-a507-62e78a6167f4', None, None, None, None, None)] {{(pid=119305) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 11:20:30.447380 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-70093a0e-4660-4bad-8c75-c62bf25fe0cd req-b0b6f066-96d3-470e-9128-cf092ef02571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4b20a22-cb3b-4fb4-8b69-3b626cd6d991", "tag": "de570ff5-446d-40b7-add4-d927b658a166"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:20:30.459560 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-70093a0e-4660-4bad-8c75-c62bf25fe0cd req-b0b6f066-96d3-470e-9128-cf092ef02571 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:30.460118 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-70093a0e-4660-4bad-8c75-c62bf25fe0cd req-b0b6f066-96d3-470e-9128-cf092ef02571 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:30.460617 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-70093a0e-4660-4bad-8c75-c62bf25fe0cd req-b0b6f066-96d3-470e-9128-cf092ef02571 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:30.472006 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-70093a0e-4660-4bad-8c75-c62bf25fe0cd req-b0b6f066-96d3-470e-9128-cf092ef02571 service nova] Creating event network-changed:de570ff5-446d-40b7-add4-d927b658a166 for instance e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 on hv-cinder-81558 Oct 26 11:20:30.477210 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-70093a0e-4660-4bad-8c75-c62bf25fe0cd req-b0b6f066-96d3-470e-9128-cf092ef02571 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033656 Oct 26 11:20:30.477793 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 147/282] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:20:30.548614 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-ac51f537-d728-4caf-904f-6599a718b0e4 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:30.549579 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-ac51f537-d728-4caf-904f-6599a718b0e4 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:30.561811 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ac51f537-d728-4caf-904f-6599a718b0e4 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:30.561811 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ac51f537-d728-4caf-904f-6599a718b0e4 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:30.561811 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ac51f537-d728-4caf-904f-6599a718b0e4 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:30.561811 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ac51f537-d728-4caf-904f-6599a718b0e4 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:30.562157 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ac51f537-d728-4caf-904f-6599a718b0e4 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:30.562258 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ac51f537-d728-4caf-904f-6599a718b0e4 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:30.704525 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ac51f537-d728-4caf-904f-6599a718b0e4 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:30.713662 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-ac51f537-d728-4caf-904f-6599a718b0e4 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1272 microversion: 2.1 time: 0.171117 Oct 26 11:20:30.714241 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 148/283] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:30 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1272 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:20:31.313177 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-a13ad0a1-9776-494f-8668-5cc2b8e78a0a tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Flavor limits 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 11:20:31.314076 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-a13ad0a1-9776-494f-8668-5cc2b8e78a0a tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Image limits 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 11:20:31.315558 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-a13ad0a1-9776-494f-8668-5cc2b8e78a0a tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Flavor pref 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 11:20:31.316165 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-a13ad0a1-9776-494f-8668-5cc2b8e78a0a tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Image pref 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 11:20:31.316768 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-a13ad0a1-9776-494f-8668-5cc2b8e78a0a tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 11:20:31.327257 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a13ad0a1-9776-494f-8668-5cc2b8e78a0a tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:31.327777 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a13ad0a1-9776-494f-8668-5cc2b8e78a0a tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:31.328218 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a13ad0a1-9776-494f-8668-5cc2b8e78a0a tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:31.329077 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a13ad0a1-9776-494f-8668-5cc2b8e78a0a tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:31.329568 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a13ad0a1-9776-494f-8668-5cc2b8e78a0a tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:31.329998 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a13ad0a1-9776-494f-8668-5cc2b8e78a0a tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:31.347016 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.quota [None req-a13ad0a1-9776-494f-8668-5cc2b8e78a0a tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Getting quotas for project 8576eb9289f147f2ab9ba6f1c00b3ffd. Resources: {'cores', 'instances', 'ram'} {{(pid=119305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:20:31.351139 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.quota [None req-a13ad0a1-9776-494f-8668-5cc2b8e78a0a tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Getting quotas for user a79972df53cf4245be9c45a9b579cff9 and project 8576eb9289f147f2ab9ba6f1c00b3ffd. Resources: {'cores', 'instances', 'ram'} {{(pid=119305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:20:31.363362 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-a13ad0a1-9776-494f-8668-5cc2b8e78a0a tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Going to run 1 instances... {{(pid=119305) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 11:20:31.365681 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-a13ad0a1-9776-494f-8668-5cc2b8e78a0a tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed8b5733-339c-4fa7-9767-abef514cb9f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119305) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 11:20:31.474605 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-a13ad0a1-9776-494f-8668-5cc2b8e78a0a tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.105808 Oct 26 11:20:31.475323 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 136/284] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Oct 26 11:20:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 11:20:31.487076 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-147b437f-c4ce-4edc-8ff5-f7ee2f84e2eb tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:31.487690 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-147b437f-c4ce-4edc-8ff5-f7ee2f84e2eb tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:31.544814 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-147b437f-c4ce-4edc-8ff5-f7ee2f84e2eb tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:31.553757 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-147b437f-c4ce-4edc-8ff5-f7ee2f84e2eb tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 200 len: 1213 microversion: 2.1 time: 0.071056 Oct 26 11:20:31.554621 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 149/285] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:31 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:31.737934 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-62a15b80-3204-43b5-98ec-8c490b3f6f06 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:31.738647 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-62a15b80-3204-43b5-98ec-8c490b3f6f06 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:31.762215 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-62a15b80-3204-43b5-98ec-8c490b3f6f06 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:31.767355 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-62a15b80-3204-43b5-98ec-8c490b3f6f06 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:31.767355 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-62a15b80-3204-43b5-98ec-8c490b3f6f06 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:31.767355 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-62a15b80-3204-43b5-98ec-8c490b3f6f06 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:31.767355 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-62a15b80-3204-43b5-98ec-8c490b3f6f06 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:31.767702 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-62a15b80-3204-43b5-98ec-8c490b3f6f06 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:32.086164 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-62a15b80-3204-43b5-98ec-8c490b3f6f06 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:32.097523 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-62a15b80-3204-43b5-98ec-8c490b3f6f06 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1260 microversion: 2.1 time: 0.364301 Oct 26 11:20:32.098119 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 137/286] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:31 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1260 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:32.576889 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-70527603-8b15-45ff-a2a2-b6f92d2bece4 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:32.577522 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-70527603-8b15-45ff-a2a2-b6f92d2bece4 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:32.579526 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:20:32.584767 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-70527603-8b15-45ff-a2a2-b6f92d2bece4 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:32.585250 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-70527603-8b15-45ff-a2a2-b6f92d2bece4 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:32.585684 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-70527603-8b15-45ff-a2a2-b6f92d2bece4 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:32.586377 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-70527603-8b15-45ff-a2a2-b6f92d2bece4 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:32.586850 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-70527603-8b15-45ff-a2a2-b6f92d2bece4 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:32.587270 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-70527603-8b15-45ff-a2a2-b6f92d2bece4 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:32.648756 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-70527603-8b15-45ff-a2a2-b6f92d2bece4 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:32.656356 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-70527603-8b15-45ff-a2a2-b6f92d2bece4 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 200 len: 1217 microversion: 2.1 time: 0.083354 Oct 26 11:20:32.656929 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 150/287] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:32 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:32.956608 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a189fa63-0c68-4cee-8a6e-ac5af3f350f8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2005800839", "imageRef": "ed8b5733-339c-4fa7-9767-abef514cb9f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0038bdd3-d1fb-456c-a8d4-41f13af7a1c5"}], "security_groups": [{"name": "tempest-securitygroup--1461691964"}], "key_name": "tempest-keypair-470444218", "user_data": "}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:20:33.060129 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.network.neutron [None req-a189fa63-0c68-4cee-8a6e-ac5af3f350f8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] validate_networks() for [('0038bdd3-d1fb-456c-a8d4-41f13af7a1c5', None, None, None, None, None)] {{(pid=119305) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 11:20:33.121333 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-f7ccedf0-c3e8-4943-8e36-65088b8c9571 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:33.121930 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-f7ccedf0-c3e8-4943-8e36-65088b8c9571 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:33.128058 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f7ccedf0-c3e8-4943-8e36-65088b8c9571 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:33.128539 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f7ccedf0-c3e8-4943-8e36-65088b8c9571 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:33.129037 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f7ccedf0-c3e8-4943-8e36-65088b8c9571 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:33.129631 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f7ccedf0-c3e8-4943-8e36-65088b8c9571 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:33.130075 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f7ccedf0-c3e8-4943-8e36-65088b8c9571 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:33.130490 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f7ccedf0-c3e8-4943-8e36-65088b8c9571 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:33.258668 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-f7ccedf0-c3e8-4943-8e36-65088b8c9571 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:33.266444 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-f7ccedf0-c3e8-4943-8e36-65088b8c9571 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1260 microversion: 2.1 time: 0.149401 Oct 26 11:20:33.267039 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 151/288] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:33 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:20:33.427808 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-a189fa63-0c68-4cee-8a6e-ac5af3f350f8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Flavor limits 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 11:20:33.428234 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-a189fa63-0c68-4cee-8a6e-ac5af3f350f8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Image limits 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 11:20:33.428712 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-a189fa63-0c68-4cee-8a6e-ac5af3f350f8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Flavor pref 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 11:20:33.429123 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-a189fa63-0c68-4cee-8a6e-ac5af3f350f8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Image pref 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 11:20:33.429539 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-a189fa63-0c68-4cee-8a6e-ac5af3f350f8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 11:20:33.438335 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a189fa63-0c68-4cee-8a6e-ac5af3f350f8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:33.438842 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a189fa63-0c68-4cee-8a6e-ac5af3f350f8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:33.439284 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a189fa63-0c68-4cee-8a6e-ac5af3f350f8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:33.440017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a189fa63-0c68-4cee-8a6e-ac5af3f350f8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:33.440511 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a189fa63-0c68-4cee-8a6e-ac5af3f350f8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:33.440939 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a189fa63-0c68-4cee-8a6e-ac5af3f350f8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:33.457830 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.quota [None req-a189fa63-0c68-4cee-8a6e-ac5af3f350f8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Getting quotas for project 9d9d2ce62fb74bdb8de53bc06b1a999d. Resources: {'cores', 'instances', 'ram'} {{(pid=119305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:20:33.461512 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.quota [None req-a189fa63-0c68-4cee-8a6e-ac5af3f350f8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Getting quotas for user ff0c5f8521534fc1a0a9c5ea28fbaac1 and project 9d9d2ce62fb74bdb8de53bc06b1a999d. Resources: {'cores', 'instances', 'ram'} {{(pid=119305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:20:33.472845 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-a189fa63-0c68-4cee-8a6e-ac5af3f350f8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Going to run 1 instances... {{(pid=119305) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 11:20:33.475005 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-a189fa63-0c68-4cee-8a6e-ac5af3f350f8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed8b5733-339c-4fa7-9767-abef514cb9f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119305) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 11:20:33.617479 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-a189fa63-0c68-4cee-8a6e-ac5af3f350f8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.665109 Oct 26 11:20:33.618137 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 138/289] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Oct 26 11:20:32 2022] POST /compute/v2.1/servers => generated 409 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 11:20:33.629905 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-fdbc9e80-dad8-4e81-ae15-4e8c70b2f6bd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:33.630605 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-fdbc9e80-dad8-4e81-ae15-4e8c70b2f6bd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:33.680295 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-2358bd3b-6920-4ad2-81a4-7721e8859b21 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:33.680825 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-2358bd3b-6920-4ad2-81a4-7721e8859b21 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:33.687689 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-fdbc9e80-dad8-4e81-ae15-4e8c70b2f6bd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:33.692907 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2358bd3b-6920-4ad2-81a4-7721e8859b21 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:33.693407 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2358bd3b-6920-4ad2-81a4-7721e8859b21 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:33.693883 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2358bd3b-6920-4ad2-81a4-7721e8859b21 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:33.695521 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2358bd3b-6920-4ad2-81a4-7721e8859b21 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:33.695984 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2358bd3b-6920-4ad2-81a4-7721e8859b21 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:33.696411 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2358bd3b-6920-4ad2-81a4-7721e8859b21 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:33.696511 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-fdbc9e80-dad8-4e81-ae15-4e8c70b2f6bd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1245 microversion: 2.1 time: 0.071061 Oct 26 11:20:33.697309 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 152/290] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:33 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1245 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:33.764401 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-2358bd3b-6920-4ad2-81a4-7721e8859b21 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:33.772846 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-2358bd3b-6920-4ad2-81a4-7721e8859b21 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 200 len: 1217 microversion: 2.1 time: 0.095926 Oct 26 11:20:33.773257 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 139/291] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:33 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:20:34.290216 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-898085bf-97cd-46d5-a1de-b195b9109a24 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:34.290839 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-898085bf-97cd-46d5-a1de-b195b9109a24 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:34.296684 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-898085bf-97cd-46d5-a1de-b195b9109a24 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:34.297168 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-898085bf-97cd-46d5-a1de-b195b9109a24 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:34.297600 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-898085bf-97cd-46d5-a1de-b195b9109a24 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:34.298285 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-898085bf-97cd-46d5-a1de-b195b9109a24 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:34.298733 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-898085bf-97cd-46d5-a1de-b195b9109a24 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:34.299183 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-898085bf-97cd-46d5-a1de-b195b9109a24 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:34.428942 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-898085bf-97cd-46d5-a1de-b195b9109a24 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:34.436970 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-898085bf-97cd-46d5-a1de-b195b9109a24 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1260 microversion: 2.1 time: 0.150737 Oct 26 11:20:34.437539 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 153/292] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:34 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:34.724241 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a4331365-9f8a-45ee-bf08-d3a1add0114b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:34.724850 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-a4331365-9f8a-45ee-bf08-d3a1add0114b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:34.731474 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a4331365-9f8a-45ee-bf08-d3a1add0114b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:34.731960 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a4331365-9f8a-45ee-bf08-d3a1add0114b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:34.732396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a4331365-9f8a-45ee-bf08-d3a1add0114b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:34.733088 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a4331365-9f8a-45ee-bf08-d3a1add0114b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:34.733545 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a4331365-9f8a-45ee-bf08-d3a1add0114b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:34.733965 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a4331365-9f8a-45ee-bf08-d3a1add0114b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:34.795107 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-c15d7b0d-4994-4b64-9e9c-9cd95e87979c tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:34.795547 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-c15d7b0d-4994-4b64-9e9c-9cd95e87979c tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:34.797051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-a4331365-9f8a-45ee-bf08-d3a1add0114b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:34.801606 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c15d7b0d-4994-4b64-9e9c-9cd95e87979c tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:34.802092 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c15d7b0d-4994-4b64-9e9c-9cd95e87979c tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:34.802530 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c15d7b0d-4994-4b64-9e9c-9cd95e87979c tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:34.803253 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c15d7b0d-4994-4b64-9e9c-9cd95e87979c tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:34.803707 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c15d7b0d-4994-4b64-9e9c-9cd95e87979c tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:34.804128 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c15d7b0d-4994-4b64-9e9c-9cd95e87979c tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:34.804658 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-a4331365-9f8a-45ee-bf08-d3a1add0114b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1249 microversion: 2.1 time: 0.084209 Oct 26 11:20:34.805229 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 140/293] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:34 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:34.867533 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-c15d7b0d-4994-4b64-9e9c-9cd95e87979c tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:34.875559 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-c15d7b0d-4994-4b64-9e9c-9cd95e87979c tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 200 len: 1217 microversion: 2.1 time: 0.084883 Oct 26 11:20:34.876219 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 154/294] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:34 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:20:35.459107 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-bd449669-abf7-4c68-9906-ae570db41c03 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:35.459728 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-bd449669-abf7-4c68-9906-ae570db41c03 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:35.465544 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bd449669-abf7-4c68-9906-ae570db41c03 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:35.466028 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bd449669-abf7-4c68-9906-ae570db41c03 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:35.466466 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bd449669-abf7-4c68-9906-ae570db41c03 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:35.467178 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bd449669-abf7-4c68-9906-ae570db41c03 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:35.467632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bd449669-abf7-4c68-9906-ae570db41c03 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:35.468075 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bd449669-abf7-4c68-9906-ae570db41c03 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:35.598399 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-bd449669-abf7-4c68-9906-ae570db41c03 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:35.606041 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-bd449669-abf7-4c68-9906-ae570db41c03 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1260 microversion: 2.1 time: 0.150621 Oct 26 11:20:35.606604 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 141/295] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:35 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:35.828132 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-a21fa22f-25a9-4a7e-bc73-9ce27800cfb5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:35.828745 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-a21fa22f-25a9-4a7e-bc73-9ce27800cfb5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:35.831164 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell0:SELECT=2 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:20:35.836189 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a21fa22f-25a9-4a7e-bc73-9ce27800cfb5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:35.836527 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a21fa22f-25a9-4a7e-bc73-9ce27800cfb5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:35.836970 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a21fa22f-25a9-4a7e-bc73-9ce27800cfb5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:35.837665 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a21fa22f-25a9-4a7e-bc73-9ce27800cfb5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:35.838118 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a21fa22f-25a9-4a7e-bc73-9ce27800cfb5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:35.838545 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a21fa22f-25a9-4a7e-bc73-9ce27800cfb5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:35.900136 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-c339ee6b-5ea1-4e86-b818-77de169de987 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:35.900609 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-c339ee6b-5ea1-4e86-b818-77de169de987 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:35.902607 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-a21fa22f-25a9-4a7e-bc73-9ce27800cfb5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:35.907017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c339ee6b-5ea1-4e86-b818-77de169de987 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:35.907499 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c339ee6b-5ea1-4e86-b818-77de169de987 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:35.907931 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c339ee6b-5ea1-4e86-b818-77de169de987 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:35.908618 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c339ee6b-5ea1-4e86-b818-77de169de987 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:35.909718 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c339ee6b-5ea1-4e86-b818-77de169de987 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:35.910138 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c339ee6b-5ea1-4e86-b818-77de169de987 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:35.910927 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-a21fa22f-25a9-4a7e-bc73-9ce27800cfb5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1241 microversion: 2.1 time: 0.086642 Oct 26 11:20:35.911504 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 155/296] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:35 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:35.970766 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-c339ee6b-5ea1-4e86-b818-77de169de987 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:35.978913 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-c339ee6b-5ea1-4e86-b818-77de169de987 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 200 len: 1265 microversion: 2.1 time: 0.083020 Oct 26 11:20:35.979477 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 142/297] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:35 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 1265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:20:36.630204 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-3cd4d72e-f34b-400e-bf90-25ba592a227a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:36.631354 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-3cd4d72e-f34b-400e-bf90-25ba592a227a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:36.637582 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3cd4d72e-f34b-400e-bf90-25ba592a227a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:36.638238 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3cd4d72e-f34b-400e-bf90-25ba592a227a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:36.638663 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3cd4d72e-f34b-400e-bf90-25ba592a227a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:36.639518 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3cd4d72e-f34b-400e-bf90-25ba592a227a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:36.640113 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3cd4d72e-f34b-400e-bf90-25ba592a227a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:36.640899 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3cd4d72e-f34b-400e-bf90-25ba592a227a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:36.771468 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-3cd4d72e-f34b-400e-bf90-25ba592a227a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:36.779185 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-3cd4d72e-f34b-400e-bf90-25ba592a227a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1260 microversion: 2.1 time: 0.153547 Oct 26 11:20:36.780178 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 156/298] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:36 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:36.933521 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-239d8287-c958-4952-876a-2d934c55a11f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:36.934153 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-239d8287-c958-4952-876a-2d934c55a11f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:36.941190 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-239d8287-c958-4952-876a-2d934c55a11f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:36.941675 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-239d8287-c958-4952-876a-2d934c55a11f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:36.942113 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-239d8287-c958-4952-876a-2d934c55a11f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:36.942811 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-239d8287-c958-4952-876a-2d934c55a11f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:36.943328 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-239d8287-c958-4952-876a-2d934c55a11f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:36.943714 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-239d8287-c958-4952-876a-2d934c55a11f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:37.002514 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-9761c969-d8b7-49d0-b019-8c99ea2381bf tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:37.003305 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-9761c969-d8b7-49d0-b019-8c99ea2381bf tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:37.009236 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9761c969-d8b7-49d0-b019-8c99ea2381bf tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:37.009749 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9761c969-d8b7-49d0-b019-8c99ea2381bf tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:37.010209 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9761c969-d8b7-49d0-b019-8c99ea2381bf tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:37.010921 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9761c969-d8b7-49d0-b019-8c99ea2381bf tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:37.011473 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9761c969-d8b7-49d0-b019-8c99ea2381bf tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:37.011924 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9761c969-d8b7-49d0-b019-8c99ea2381bf tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:37.018908 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-239d8287-c958-4952-876a-2d934c55a11f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:37.027664 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-239d8287-c958-4952-876a-2d934c55a11f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1297 microversion: 2.1 time: 0.097930 Oct 26 11:20:37.039254 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 143/299] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:36 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1297 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:37.227059 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-9761c969-d8b7-49d0-b019-8c99ea2381bf tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:37.237311 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-9761c969-d8b7-49d0-b019-8c99ea2381bf tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 200 len: 1313 microversion: 2.1 time: 0.238787 Oct 26 11:20:37.239881 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 157/300] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:36 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:20:37.801824 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-23e244c2-60bd-42a1-8c21-3df52a2f61b6 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:37.802442 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-23e244c2-60bd-42a1-8c21-3df52a2f61b6 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:37.808971 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-23e244c2-60bd-42a1-8c21-3df52a2f61b6 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:37.811493 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-23e244c2-60bd-42a1-8c21-3df52a2f61b6 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:37.811493 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-23e244c2-60bd-42a1-8c21-3df52a2f61b6 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:37.811493 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-23e244c2-60bd-42a1-8c21-3df52a2f61b6 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:37.811493 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-23e244c2-60bd-42a1-8c21-3df52a2f61b6 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:37.812131 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-23e244c2-60bd-42a1-8c21-3df52a2f61b6 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:37.893281 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-09ab0802-891e-4388-ad01-c0cc183331d6 req-8b2f1c73-3cf0-4f7b-a4d2-446c11e52b5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b059e78c-afde-4f1f-9a77-b2d6d5aa4e77", "tag": "888991fc-f82a-47f3-b3e6-2895c3ae654e"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:20:37.903574 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-09ab0802-891e-4388-ad01-c0cc183331d6 req-8b2f1c73-3cf0-4f7b-a4d2-446c11e52b5f service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:37.904049 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-09ab0802-891e-4388-ad01-c0cc183331d6 req-8b2f1c73-3cf0-4f7b-a4d2-446c11e52b5f service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:37.904471 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-09ab0802-891e-4388-ad01-c0cc183331d6 req-8b2f1c73-3cf0-4f7b-a4d2-446c11e52b5f service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:37.915482 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-09ab0802-891e-4388-ad01-c0cc183331d6 req-8b2f1c73-3cf0-4f7b-a4d2-446c11e52b5f service nova] Creating event network-changed:888991fc-f82a-47f3-b3e6-2895c3ae654e for instance b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 on hv-cinder-81558 Oct 26 11:20:37.921106 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-09ab0802-891e-4388-ad01-c0cc183331d6 req-8b2f1c73-3cf0-4f7b-a4d2-446c11e52b5f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032101 Oct 26 11:20:37.921939 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 158/301] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:20:37.997244 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-23e244c2-60bd-42a1-8c21-3df52a2f61b6 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:38.022497 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-23e244c2-60bd-42a1-8c21-3df52a2f61b6 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1260 microversion: 2.1 time: 0.214423 Oct 26 11:20:38.022497 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 144/302] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:37 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1260 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:38.052858 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-34bb8a49-e8c3-420a-861d-5577249d7fd9 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:38.053574 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-34bb8a49-e8c3-420a-861d-5577249d7fd9 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:38.061478 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-34bb8a49-e8c3-420a-861d-5577249d7fd9 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:38.062222 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-34bb8a49-e8c3-420a-861d-5577249d7fd9 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:38.062886 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-34bb8a49-e8c3-420a-861d-5577249d7fd9 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:38.063757 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-34bb8a49-e8c3-420a-861d-5577249d7fd9 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:38.064212 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-34bb8a49-e8c3-420a-861d-5577249d7fd9 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:38.064637 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-34bb8a49-e8c3-420a-861d-5577249d7fd9 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:38.262320 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-cd53520f-0349-4842-9bac-62866be6852f tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:38.263298 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-cd53520f-0349-4842-9bac-62866be6852f tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:38.275227 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:20:38.277820 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cd53520f-0349-4842-9bac-62866be6852f tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:38.279441 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cd53520f-0349-4842-9bac-62866be6852f tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:38.280040 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cd53520f-0349-4842-9bac-62866be6852f tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:38.281740 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cd53520f-0349-4842-9bac-62866be6852f tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:38.283378 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cd53520f-0349-4842-9bac-62866be6852f tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:38.284470 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cd53520f-0349-4842-9bac-62866be6852f tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:38.314755 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-34bb8a49-e8c3-420a-861d-5577249d7fd9 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:38.329708 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-34bb8a49-e8c3-420a-861d-5577249d7fd9 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1371 microversion: 2.1 time: 0.281944 Oct 26 11:20:38.330607 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 159/303] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:38 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1371 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:38.443594 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-cd53520f-0349-4842-9bac-62866be6852f tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:38.452627 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-cd53520f-0349-4842-9bac-62866be6852f tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 200 len: 1313 microversion: 2.1 time: 0.195425 Oct 26 11:20:38.453311 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 145/304] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:38 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:39.043277 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-c2192401-0d74-4eef-8fbf-2aae42dfe9ee tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:39.043896 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-c2192401-0d74-4eef-8fbf-2aae42dfe9ee tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:39.051168 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c2192401-0d74-4eef-8fbf-2aae42dfe9ee tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:39.051687 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c2192401-0d74-4eef-8fbf-2aae42dfe9ee tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:39.052124 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c2192401-0d74-4eef-8fbf-2aae42dfe9ee tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:39.052819 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c2192401-0d74-4eef-8fbf-2aae42dfe9ee tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:39.053275 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c2192401-0d74-4eef-8fbf-2aae42dfe9ee tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:39.053934 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c2192401-0d74-4eef-8fbf-2aae42dfe9ee tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:39.165025 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-78379317-30ca-42da-aa2b-c569f7b2b1c5 req-3b15681d-7e48-4310-8d0a-9e85e23daf13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "975e97a1-fe2c-4f81-88b5-274a052109c6", "tag": "aa03144d-b19b-4e5d-8027-1ca2393de35d"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:20:39.177349 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-78379317-30ca-42da-aa2b-c569f7b2b1c5 req-3b15681d-7e48-4310-8d0a-9e85e23daf13 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:39.177892 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-78379317-30ca-42da-aa2b-c569f7b2b1c5 req-3b15681d-7e48-4310-8d0a-9e85e23daf13 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:39.178427 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-78379317-30ca-42da-aa2b-c569f7b2b1c5 req-3b15681d-7e48-4310-8d0a-9e85e23daf13 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:39.191612 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-78379317-30ca-42da-aa2b-c569f7b2b1c5 req-3b15681d-7e48-4310-8d0a-9e85e23daf13 service nova] Creating event network-changed:aa03144d-b19b-4e5d-8027-1ca2393de35d for instance 975e97a1-fe2c-4f81-88b5-274a052109c6 on hv-cinder-81558 Oct 26 11:20:39.197110 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-78379317-30ca-42da-aa2b-c569f7b2b1c5 req-3b15681d-7e48-4310-8d0a-9e85e23daf13 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036222 Oct 26 11:20:39.197780 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 146/305] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:20:39.263553 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-c2192401-0d74-4eef-8fbf-2aae42dfe9ee tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:39.276293 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-c2192401-0d74-4eef-8fbf-2aae42dfe9ee tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1260 microversion: 2.1 time: 0.237030 Oct 26 11:20:39.277439 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 160/306] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:39 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:39.359724 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-ae1f453f-a244-4bb5-966b-1233b8208a0b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:39.360643 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-ae1f453f-a244-4bb5-966b-1233b8208a0b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:39.367398 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ae1f453f-a244-4bb5-966b-1233b8208a0b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:39.367887 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ae1f453f-a244-4bb5-966b-1233b8208a0b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:39.368327 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ae1f453f-a244-4bb5-966b-1233b8208a0b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:39.369023 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ae1f453f-a244-4bb5-966b-1233b8208a0b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:39.369579 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ae1f453f-a244-4bb5-966b-1233b8208a0b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:39.370012 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ae1f453f-a244-4bb5-966b-1233b8208a0b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:39.475564 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-f25d78ce-4aa6-4619-a8a7-f5acefac83d2 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:39.476265 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-f25d78ce-4aa6-4619-a8a7-f5acefac83d2 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:39.482174 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f25d78ce-4aa6-4619-a8a7-f5acefac83d2 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:39.482630 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f25d78ce-4aa6-4619-a8a7-f5acefac83d2 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:39.483177 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f25d78ce-4aa6-4619-a8a7-f5acefac83d2 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:39.483926 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f25d78ce-4aa6-4619-a8a7-f5acefac83d2 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:39.484448 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f25d78ce-4aa6-4619-a8a7-f5acefac83d2 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:39.484934 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f25d78ce-4aa6-4619-a8a7-f5acefac83d2 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:39.501511 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-ae1f453f-a244-4bb5-966b-1233b8208a0b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:39.509619 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-ae1f453f-a244-4bb5-966b-1233b8208a0b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1371 microversion: 2.1 time: 0.154552 Oct 26 11:20:39.510184 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 147/307] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:39 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:39.612372 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-f25d78ce-4aa6-4619-a8a7-f5acefac83d2 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:39.619917 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-f25d78ce-4aa6-4619-a8a7-f5acefac83d2 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 200 len: 1313 microversion: 2.1 time: 0.148322 Oct 26 11:20:39.620486 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 161/308] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:39 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:20:40.308356 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-c450fcd1-dfe8-4579-9a57-c36d7c6ee18c tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:40.308965 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-c450fcd1-dfe8-4579-9a57-c36d7c6ee18c tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:40.315604 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c450fcd1-dfe8-4579-9a57-c36d7c6ee18c tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:40.316080 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c450fcd1-dfe8-4579-9a57-c36d7c6ee18c tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:40.316509 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c450fcd1-dfe8-4579-9a57-c36d7c6ee18c tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:40.317690 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c450fcd1-dfe8-4579-9a57-c36d7c6ee18c tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:40.318142 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c450fcd1-dfe8-4579-9a57-c36d7c6ee18c tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:40.318560 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c450fcd1-dfe8-4579-9a57-c36d7c6ee18c tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:40.445884 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-c450fcd1-dfe8-4579-9a57-c36d7c6ee18c tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:40.453437 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-c450fcd1-dfe8-4579-9a57-c36d7c6ee18c tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1260 microversion: 2.1 time: 0.148875 Oct 26 11:20:40.453999 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 148/309] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:40 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:40.532826 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-63f740bf-fbaf-4390-99ad-c917861ba4cd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:40.533433 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-63f740bf-fbaf-4390-99ad-c917861ba4cd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:40.539331 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-63f740bf-fbaf-4390-99ad-c917861ba4cd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:40.539811 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-63f740bf-fbaf-4390-99ad-c917861ba4cd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:40.540245 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-63f740bf-fbaf-4390-99ad-c917861ba4cd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:40.540926 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-63f740bf-fbaf-4390-99ad-c917861ba4cd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:40.541379 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-63f740bf-fbaf-4390-99ad-c917861ba4cd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:40.541807 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-63f740bf-fbaf-4390-99ad-c917861ba4cd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:40.643239 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-520bb133-9057-4cbf-990c-7da44d194794 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:40.643848 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-520bb133-9057-4cbf-990c-7da44d194794 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:40.649692 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-520bb133-9057-4cbf-990c-7da44d194794 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:40.650150 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-520bb133-9057-4cbf-990c-7da44d194794 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:40.650584 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-520bb133-9057-4cbf-990c-7da44d194794 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:40.651291 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-520bb133-9057-4cbf-990c-7da44d194794 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:40.651766 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-520bb133-9057-4cbf-990c-7da44d194794 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:40.652185 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-520bb133-9057-4cbf-990c-7da44d194794 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:40.667213 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-63f740bf-fbaf-4390-99ad-c917861ba4cd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:40.674782 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-63f740bf-fbaf-4390-99ad-c917861ba4cd tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1371 microversion: 2.1 time: 0.145743 Oct 26 11:20:40.675407 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 162/310] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:40 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:40.803443 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-520bb133-9057-4cbf-990c-7da44d194794 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:40.810951 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-520bb133-9057-4cbf-990c-7da44d194794 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 200 len: 1313 microversion: 2.1 time: 0.171529 Oct 26 11:20:40.811512 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 149/311] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:40 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:20:41.476863 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-a87ecaf9-1e5d-449c-ab45-76605f8eea00 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:41.477468 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-a87ecaf9-1e5d-449c-ab45-76605f8eea00 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:41.483197 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a87ecaf9-1e5d-449c-ab45-76605f8eea00 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:41.483681 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a87ecaf9-1e5d-449c-ab45-76605f8eea00 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:41.484114 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a87ecaf9-1e5d-449c-ab45-76605f8eea00 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:41.484789 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a87ecaf9-1e5d-449c-ab45-76605f8eea00 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:41.485234 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a87ecaf9-1e5d-449c-ab45-76605f8eea00 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:41.485648 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a87ecaf9-1e5d-449c-ab45-76605f8eea00 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:41.611222 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-a87ecaf9-1e5d-449c-ab45-76605f8eea00 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:41.618780 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-a87ecaf9-1e5d-449c-ab45-76605f8eea00 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1260 microversion: 2.1 time: 0.146375 Oct 26 11:20:41.619369 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 163/312] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:41 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1260 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:41.698345 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-55258275-a681-4373-943b-6788cb00d4cb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:41.698991 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-55258275-a681-4373-943b-6788cb00d4cb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:41.705332 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-55258275-a681-4373-943b-6788cb00d4cb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:41.705809 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-55258275-a681-4373-943b-6788cb00d4cb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:41.706244 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-55258275-a681-4373-943b-6788cb00d4cb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:41.706956 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-55258275-a681-4373-943b-6788cb00d4cb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:41.707405 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-55258275-a681-4373-943b-6788cb00d4cb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:41.707878 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-55258275-a681-4373-943b-6788cb00d4cb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:41.834298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-621612c0-2d9e-40ee-aeec-3372470dcf97 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:41.834566 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-55258275-a681-4373-943b-6788cb00d4cb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:41.834972 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-621612c0-2d9e-40ee-aeec-3372470dcf97 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:41.838163 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=100 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:20:41.841165 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-621612c0-2d9e-40ee-aeec-3372470dcf97 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:41.844844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-621612c0-2d9e-40ee-aeec-3372470dcf97 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:41.844844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-621612c0-2d9e-40ee-aeec-3372470dcf97 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:41.845056 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-55258275-a681-4373-943b-6788cb00d4cb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1371 microversion: 2.1 time: 0.148154 Oct 26 11:20:41.845164 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-621612c0-2d9e-40ee-aeec-3372470dcf97 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:41.845164 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-621612c0-2d9e-40ee-aeec-3372470dcf97 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:41.845327 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 150/313] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:41 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:41.845420 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-621612c0-2d9e-40ee-aeec-3372470dcf97 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:41.971856 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-621612c0-2d9e-40ee-aeec-3372470dcf97 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:41.979397 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-621612c0-2d9e-40ee-aeec-3372470dcf97 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 200 len: 1313 microversion: 2.1 time: 0.149650 Oct 26 11:20:41.979964 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 164/314] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:41 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:42.641039 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-3dbad4ff-a797-4320-a8a8-5eb8dc9a6fd7 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:42.641644 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-3dbad4ff-a797-4320-a8a8-5eb8dc9a6fd7 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:42.648494 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3dbad4ff-a797-4320-a8a8-5eb8dc9a6fd7 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:42.648974 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3dbad4ff-a797-4320-a8a8-5eb8dc9a6fd7 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:42.649404 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3dbad4ff-a797-4320-a8a8-5eb8dc9a6fd7 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:42.650085 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3dbad4ff-a797-4320-a8a8-5eb8dc9a6fd7 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:42.650531 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3dbad4ff-a797-4320-a8a8-5eb8dc9a6fd7 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:42.650980 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3dbad4ff-a797-4320-a8a8-5eb8dc9a6fd7 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:42.781458 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-3dbad4ff-a797-4320-a8a8-5eb8dc9a6fd7 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:42.789710 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-3dbad4ff-a797-4320-a8a8-5eb8dc9a6fd7 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1260 microversion: 2.1 time: 0.152592 Oct 26 11:20:42.790278 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 151/315] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:42 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:42.865232 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-abf1c985-6725-4264-a79d-a765e0f58336 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:42.865841 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-abf1c985-6725-4264-a79d-a765e0f58336 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:42.871805 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-abf1c985-6725-4264-a79d-a765e0f58336 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:42.872290 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-abf1c985-6725-4264-a79d-a765e0f58336 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:42.872726 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-abf1c985-6725-4264-a79d-a765e0f58336 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:42.873413 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-abf1c985-6725-4264-a79d-a765e0f58336 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:42.873862 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-abf1c985-6725-4264-a79d-a765e0f58336 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:42.874286 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-abf1c985-6725-4264-a79d-a765e0f58336 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:42.999579 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-abf1c985-6725-4264-a79d-a765e0f58336 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:43.002400 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-356f0810-f0e1-4174-a4cf-cac80cf62951 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:43.003059 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-356f0810-f0e1-4174-a4cf-cac80cf62951 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:43.007584 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-abf1c985-6725-4264-a79d-a765e0f58336 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1371 microversion: 2.1 time: 0.146204 Oct 26 11:20:43.010548 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 165/316] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:42 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:43.010678 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-356f0810-f0e1-4174-a4cf-cac80cf62951 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:43.010678 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-356f0810-f0e1-4174-a4cf-cac80cf62951 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:43.010678 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-356f0810-f0e1-4174-a4cf-cac80cf62951 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:43.010678 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-356f0810-f0e1-4174-a4cf-cac80cf62951 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:43.011055 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-356f0810-f0e1-4174-a4cf-cac80cf62951 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:43.011293 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-356f0810-f0e1-4174-a4cf-cac80cf62951 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:43.137649 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-356f0810-f0e1-4174-a4cf-cac80cf62951 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:43.145147 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-356f0810-f0e1-4174-a4cf-cac80cf62951 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 200 len: 1313 microversion: 2.1 time: 0.146547 Oct 26 11:20:43.146200 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 152/317] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:42 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:20:43.812939 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-70e5ceef-ba2e-408d-bdc0-03e1bafc9c35 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:43.813580 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-70e5ceef-ba2e-408d-bdc0-03e1bafc9c35 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:43.815536 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell0:SELECT=10 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:20:43.820895 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-70e5ceef-ba2e-408d-bdc0-03e1bafc9c35 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:43.821395 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-70e5ceef-ba2e-408d-bdc0-03e1bafc9c35 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:43.821810 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-70e5ceef-ba2e-408d-bdc0-03e1bafc9c35 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:43.822487 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-70e5ceef-ba2e-408d-bdc0-03e1bafc9c35 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:43.822970 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-70e5ceef-ba2e-408d-bdc0-03e1bafc9c35 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:43.827675 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-70e5ceef-ba2e-408d-bdc0-03e1bafc9c35 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:43.827675 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=100 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:20:43.953995 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-70e5ceef-ba2e-408d-bdc0-03e1bafc9c35 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:43.961564 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-70e5ceef-ba2e-408d-bdc0-03e1bafc9c35 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1260 microversion: 2.1 time: 0.152776 Oct 26 11:20:43.962121 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 166/318] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:43 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:44.030556 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-29219558-d867-48c5-ac05-48ee2a310324 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:44.031151 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-29219558-d867-48c5-ac05-48ee2a310324 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:44.032976 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell0:SELECT=4 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:20:44.033639 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell0:SELECT=18 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:20:44.039346 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-29219558-d867-48c5-ac05-48ee2a310324 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:44.044132 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-29219558-d867-48c5-ac05-48ee2a310324 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:44.044132 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-29219558-d867-48c5-ac05-48ee2a310324 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:44.044132 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-29219558-d867-48c5-ac05-48ee2a310324 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:44.044132 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-29219558-d867-48c5-ac05-48ee2a310324 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:44.044492 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-29219558-d867-48c5-ac05-48ee2a310324 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:44.168225 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-29219558-d867-48c5-ac05-48ee2a310324 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:44.168698 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-9603044a-6e07-46a8-a57e-331a006b57d7 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:44.169341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-9603044a-6e07-46a8-a57e-331a006b57d7 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:44.175262 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9603044a-6e07-46a8-a57e-331a006b57d7 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:44.175749 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9603044a-6e07-46a8-a57e-331a006b57d7 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:44.175891 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-29219558-d867-48c5-ac05-48ee2a310324 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1371 microversion: 2.1 time: 0.149104 Oct 26 11:20:44.176311 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9603044a-6e07-46a8-a57e-331a006b57d7 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:44.176424 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 153/319] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:44 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:44.177684 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9603044a-6e07-46a8-a57e-331a006b57d7 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:44.178143 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9603044a-6e07-46a8-a57e-331a006b57d7 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:44.178564 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9603044a-6e07-46a8-a57e-331a006b57d7 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:44.303670 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-9603044a-6e07-46a8-a57e-331a006b57d7 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:44.311254 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-9603044a-6e07-46a8-a57e-331a006b57d7 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 200 len: 1313 microversion: 2.1 time: 0.146628 Oct 26 11:20:44.311837 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 167/320] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:44 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:20:44.984666 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-c661934b-dc99-4f53-a9c1-4cef3983c6ac tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:44.985291 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-c661934b-dc99-4f53-a9c1-4cef3983c6ac tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:44.991137 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c661934b-dc99-4f53-a9c1-4cef3983c6ac tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:44.991617 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c661934b-dc99-4f53-a9c1-4cef3983c6ac tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:44.992047 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c661934b-dc99-4f53-a9c1-4cef3983c6ac tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:44.992727 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c661934b-dc99-4f53-a9c1-4cef3983c6ac tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:44.993175 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c661934b-dc99-4f53-a9c1-4cef3983c6ac tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:44.993592 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c661934b-dc99-4f53-a9c1-4cef3983c6ac tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:45.122550 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-c661934b-dc99-4f53-a9c1-4cef3983c6ac tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:45.130748 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-c661934b-dc99-4f53-a9c1-4cef3983c6ac tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1260 microversion: 2.1 time: 0.149358 Oct 26 11:20:45.131355 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 154/321] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:44 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:45.199736 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-603c58fa-7f36-44f9-880b-44f44ef79799 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:45.200349 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-603c58fa-7f36-44f9-880b-44f44ef79799 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:45.206120 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-603c58fa-7f36-44f9-880b-44f44ef79799 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:45.206615 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-603c58fa-7f36-44f9-880b-44f44ef79799 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:45.207066 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-603c58fa-7f36-44f9-880b-44f44ef79799 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:45.207744 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-603c58fa-7f36-44f9-880b-44f44ef79799 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:45.208193 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-603c58fa-7f36-44f9-880b-44f44ef79799 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:45.208614 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-603c58fa-7f36-44f9-880b-44f44ef79799 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:45.334063 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-603c58fa-7f36-44f9-880b-44f44ef79799 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:45.334700 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-da7c04ab-3338-44c1-bc36-bb045c75fee5 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:45.335347 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-da7c04ab-3338-44c1-bc36-bb045c75fee5 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:45.341183 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-da7c04ab-3338-44c1-bc36-bb045c75fee5 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:45.341665 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-da7c04ab-3338-44c1-bc36-bb045c75fee5 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:45.342067 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-603c58fa-7f36-44f9-880b-44f44ef79799 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1371 microversion: 2.1 time: 0.146060 Oct 26 11:20:45.342176 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-da7c04ab-3338-44c1-bc36-bb045c75fee5 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:45.342776 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-da7c04ab-3338-44c1-bc36-bb045c75fee5 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:45.342893 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 168/322] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:45 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:45.343259 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-da7c04ab-3338-44c1-bc36-bb045c75fee5 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:45.343768 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-da7c04ab-3338-44c1-bc36-bb045c75fee5 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:45.470209 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-da7c04ab-3338-44c1-bc36-bb045c75fee5 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:45.478285 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-da7c04ab-3338-44c1-bc36-bb045c75fee5 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 200 len: 1313 microversion: 2.1 time: 0.147491 Oct 26 11:20:45.478865 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 155/323] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:45 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:20:46.153336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-1b755fc3-e311-4e35-b35f-700a077e63d9 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:46.153967 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-1b755fc3-e311-4e35-b35f-700a077e63d9 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:46.159992 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1b755fc3-e311-4e35-b35f-700a077e63d9 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:46.160473 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1b755fc3-e311-4e35-b35f-700a077e63d9 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:46.160909 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1b755fc3-e311-4e35-b35f-700a077e63d9 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:46.162228 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1b755fc3-e311-4e35-b35f-700a077e63d9 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:46.162687 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1b755fc3-e311-4e35-b35f-700a077e63d9 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:46.163135 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1b755fc3-e311-4e35-b35f-700a077e63d9 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:46.288050 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-1b755fc3-e311-4e35-b35f-700a077e63d9 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:46.295672 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-1b755fc3-e311-4e35-b35f-700a077e63d9 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1260 microversion: 2.1 time: 0.146435 Oct 26 11:20:46.296243 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 169/324] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:46 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:46.364682 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-30cb1d3a-e8d6-4c71-873e-ed5358af0364 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:46.365290 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-30cb1d3a-e8d6-4c71-873e-ed5358af0364 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:46.371620 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-30cb1d3a-e8d6-4c71-873e-ed5358af0364 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:46.372098 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-30cb1d3a-e8d6-4c71-873e-ed5358af0364 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:46.372531 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-30cb1d3a-e8d6-4c71-873e-ed5358af0364 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:46.373227 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-30cb1d3a-e8d6-4c71-873e-ed5358af0364 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:46.373672 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-30cb1d3a-e8d6-4c71-873e-ed5358af0364 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:46.374089 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-30cb1d3a-e8d6-4c71-873e-ed5358af0364 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:46.501557 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-f0f9fcca-8577-4662-9047-8c2c509cfdc9 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:46.502166 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-f0f9fcca-8577-4662-9047-8c2c509cfdc9 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:46.507712 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-30cb1d3a-e8d6-4c71-873e-ed5358af0364 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:46.508825 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f0f9fcca-8577-4662-9047-8c2c509cfdc9 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:46.509305 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f0f9fcca-8577-4662-9047-8c2c509cfdc9 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:46.509738 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f0f9fcca-8577-4662-9047-8c2c509cfdc9 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:46.510431 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f0f9fcca-8577-4662-9047-8c2c509cfdc9 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:46.510901 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f0f9fcca-8577-4662-9047-8c2c509cfdc9 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:46.511320 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f0f9fcca-8577-4662-9047-8c2c509cfdc9 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:46.515435 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-30cb1d3a-e8d6-4c71-873e-ed5358af0364 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1371 microversion: 2.1 time: 0.154497 Oct 26 11:20:46.515999 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 156/325] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:46 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:46.636185 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-f0f9fcca-8577-4662-9047-8c2c509cfdc9 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:46.643733 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-f0f9fcca-8577-4662-9047-8c2c509cfdc9 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 200 len: 1313 microversion: 2.1 time: 0.146095 Oct 26 11:20:46.644288 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 170/326] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:46 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:20:47.318482 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-9fcc01ef-8fff-4fe1-837c-3b0d9767c301 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:47.319120 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-9fcc01ef-8fff-4fe1-837c-3b0d9767c301 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:47.325020 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9fcc01ef-8fff-4fe1-837c-3b0d9767c301 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:47.325501 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9fcc01ef-8fff-4fe1-837c-3b0d9767c301 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:47.325942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9fcc01ef-8fff-4fe1-837c-3b0d9767c301 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:47.326626 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9fcc01ef-8fff-4fe1-837c-3b0d9767c301 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:47.327099 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9fcc01ef-8fff-4fe1-837c-3b0d9767c301 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:47.327519 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9fcc01ef-8fff-4fe1-837c-3b0d9767c301 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:47.456858 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-9fcc01ef-8fff-4fe1-837c-3b0d9767c301 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:47.465101 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-9fcc01ef-8fff-4fe1-837c-3b0d9767c301 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1260 microversion: 2.1 time: 0.150514 Oct 26 11:20:47.465673 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 157/327] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:47 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:20:47.538036 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-47a6df96-2d9d-43ac-98fd-f11cb0fd888d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:47.538644 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-47a6df96-2d9d-43ac-98fd-f11cb0fd888d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:47.544479 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-47a6df96-2d9d-43ac-98fd-f11cb0fd888d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:47.544958 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-47a6df96-2d9d-43ac-98fd-f11cb0fd888d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:47.545389 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-47a6df96-2d9d-43ac-98fd-f11cb0fd888d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:47.546068 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-47a6df96-2d9d-43ac-98fd-f11cb0fd888d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:47.546515 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-47a6df96-2d9d-43ac-98fd-f11cb0fd888d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:47.546953 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-47a6df96-2d9d-43ac-98fd-f11cb0fd888d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:47.668347 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a7597136-3237-4e88-9e50-551f9d954196 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:47.669178 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-a7597136-3237-4e88-9e50-551f9d954196 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:47.675696 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-47a6df96-2d9d-43ac-98fd-f11cb0fd888d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:47.677983 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a7597136-3237-4e88-9e50-551f9d954196 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:47.678523 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a7597136-3237-4e88-9e50-551f9d954196 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:47.679028 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a7597136-3237-4e88-9e50-551f9d954196 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:47.683245 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a7597136-3237-4e88-9e50-551f9d954196 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:47.683245 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a7597136-3237-4e88-9e50-551f9d954196 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:47.683245 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a7597136-3237-4e88-9e50-551f9d954196 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:47.687344 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-47a6df96-2d9d-43ac-98fd-f11cb0fd888d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1371 microversion: 2.1 time: 0.153697 Oct 26 11:20:47.703737 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 171/328] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:47 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:47.819385 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-a7597136-3237-4e88-9e50-551f9d954196 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:47.827546 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-a7597136-3237-4e88-9e50-551f9d954196 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 200 len: 1313 microversion: 2.1 time: 0.165134 Oct 26 11:20:47.828121 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 158/329] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:47 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:20:48.487468 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-ff8ed091-3357-4527-a7ec-d164748cfd99 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:48.488079 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-ff8ed091-3357-4527-a7ec-d164748cfd99 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:48.493953 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ff8ed091-3357-4527-a7ec-d164748cfd99 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:48.494433 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ff8ed091-3357-4527-a7ec-d164748cfd99 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:48.494894 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ff8ed091-3357-4527-a7ec-d164748cfd99 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:48.496530 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ff8ed091-3357-4527-a7ec-d164748cfd99 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:48.496530 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ff8ed091-3357-4527-a7ec-d164748cfd99 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:48.496530 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ff8ed091-3357-4527-a7ec-d164748cfd99 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:48.627015 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ff8ed091-3357-4527-a7ec-d164748cfd99 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:48.635146 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-ff8ed091-3357-4527-a7ec-d164748cfd99 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1260 microversion: 2.1 time: 0.151617 Oct 26 11:20:48.635717 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 172/330] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:48 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:48.712017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-80b07f3c-c23a-44a5-a439-c9ce4c30bbed tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:48.712624 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-80b07f3c-c23a-44a5-a439-c9ce4c30bbed tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:48.719125 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-80b07f3c-c23a-44a5-a439-c9ce4c30bbed tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:48.719610 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-80b07f3c-c23a-44a5-a439-c9ce4c30bbed tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:48.720162 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-80b07f3c-c23a-44a5-a439-c9ce4c30bbed tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:48.723052 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-80b07f3c-c23a-44a5-a439-c9ce4c30bbed tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:48.723052 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-80b07f3c-c23a-44a5-a439-c9ce4c30bbed tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:48.723052 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-80b07f3c-c23a-44a5-a439-c9ce4c30bbed tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:48.850805 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-65f47f10-7ae6-4421-8023-5cb9e13c962d tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:48.851704 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-65f47f10-7ae6-4421-8023-5cb9e13c962d tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:48.856686 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-80b07f3c-c23a-44a5-a439-c9ce4c30bbed tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:48.857819 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-65f47f10-7ae6-4421-8023-5cb9e13c962d tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:48.858514 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-65f47f10-7ae6-4421-8023-5cb9e13c962d tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:48.858974 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-65f47f10-7ae6-4421-8023-5cb9e13c962d tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:48.859663 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-65f47f10-7ae6-4421-8023-5cb9e13c962d tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:48.860306 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-65f47f10-7ae6-4421-8023-5cb9e13c962d tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:48.860724 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-65f47f10-7ae6-4421-8023-5cb9e13c962d tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:48.867268 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-80b07f3c-c23a-44a5-a439-c9ce4c30bbed tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1371 microversion: 2.1 time: 0.159498 Oct 26 11:20:48.868716 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 159/331] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:48 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:48.931432 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-fff05be2-34ff-4360-8c88-863b3437ef2c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2106473730", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1078387089", "security_groups": [{"name": "tempest-secgroup-smoke-1592834590"}], "block_device_mapping_v2": [{"uuid": "6e084556-cf83-4e79-b299-7eaa1860adc3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5b1f4268-e846-46c0-b38f-b877c6621858"}]}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:20:49.055496 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.network.neutron [None req-fff05be2-34ff-4360-8c88-863b3437ef2c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] validate_networks() for [('5b1f4268-e846-46c0-b38f-b877c6621858', None, None, None, None, None)] {{(pid=119305) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 11:20:49.194480 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-65f47f10-7ae6-4421-8023-5cb9e13c962d tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:49.202420 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-65f47f10-7ae6-4421-8023-5cb9e13c962d tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 200 len: 1313 microversion: 2.1 time: 0.355420 Oct 26 11:20:49.203036 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 173/332] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:48 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 1313 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:20:49.422198 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-fff05be2-34ff-4360-8c88-863b3437ef2c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Flavor limits 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 11:20:49.422621 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-fff05be2-34ff-4360-8c88-863b3437ef2c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Image limits 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 11:20:49.423156 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-fff05be2-34ff-4360-8c88-863b3437ef2c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Flavor pref 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 11:20:49.423562 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-fff05be2-34ff-4360-8c88-863b3437ef2c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Image pref 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 11:20:49.423967 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-fff05be2-34ff-4360-8c88-863b3437ef2c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 11:20:49.433283 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fff05be2-34ff-4360-8c88-863b3437ef2c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:49.433757 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fff05be2-34ff-4360-8c88-863b3437ef2c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:49.434187 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fff05be2-34ff-4360-8c88-863b3437ef2c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:49.434940 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fff05be2-34ff-4360-8c88-863b3437ef2c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:49.435744 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fff05be2-34ff-4360-8c88-863b3437ef2c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:49.436163 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fff05be2-34ff-4360-8c88-863b3437ef2c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:49.452902 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.quota [None req-fff05be2-34ff-4360-8c88-863b3437ef2c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Getting quotas for project e378bfab9d91492e81320139fed867c6. Resources: {'cores', 'instances', 'ram'} {{(pid=119305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:20:49.456727 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.quota [None req-fff05be2-34ff-4360-8c88-863b3437ef2c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Getting quotas for user 1f737b4d0531425cbc803fcd15a3ea1f and project e378bfab9d91492e81320139fed867c6. Resources: {'cores', 'instances', 'ram'} {{(pid=119305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:20:49.512150 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-fff05be2-34ff-4360-8c88-863b3437ef2c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Going to run 1 instances... {{(pid=119305) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 11:20:49.514356 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-fff05be2-34ff-4360-8c88-863b3437ef2c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6e084556-cf83-4e79-b299-7eaa1860adc3',volume_size=None,volume_type=None)] {{(pid=119305) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 11:20:49.658838 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-57154314-68c0-4887-9693-417e13b2f0ad tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:49.659448 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-57154314-68c0-4887-9693-417e13b2f0ad tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:49.665834 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-57154314-68c0-4887-9693-417e13b2f0ad tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:49.666317 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-57154314-68c0-4887-9693-417e13b2f0ad tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:49.666753 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-57154314-68c0-4887-9693-417e13b2f0ad tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:49.668865 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-57154314-68c0-4887-9693-417e13b2f0ad tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:49.668865 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-57154314-68c0-4887-9693-417e13b2f0ad tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:49.668865 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-57154314-68c0-4887-9693-417e13b2f0ad tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:49.797957 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-57154314-68c0-4887-9693-417e13b2f0ad tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:49.805882 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-57154314-68c0-4887-9693-417e13b2f0ad tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1260 microversion: 2.1 time: 0.150980 Oct 26 11:20:49.806459 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 174/333] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:49 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:20:49.890532 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-14437cd4-2c4f-4d8e-9f75-9264f212faa6 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:49.891194 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-14437cd4-2c4f-4d8e-9f75-9264f212faa6 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:49.897558 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-14437cd4-2c4f-4d8e-9f75-9264f212faa6 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:49.898036 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-14437cd4-2c4f-4d8e-9f75-9264f212faa6 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:49.899294 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-14437cd4-2c4f-4d8e-9f75-9264f212faa6 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:49.899294 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-14437cd4-2c4f-4d8e-9f75-9264f212faa6 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:49.899652 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-14437cd4-2c4f-4d8e-9f75-9264f212faa6 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:49.900071 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-14437cd4-2c4f-4d8e-9f75-9264f212faa6 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:49.932770 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-fff05be2-34ff-4360-8c88-863b3437ef2c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.005757 Oct 26 11:20:49.933514 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 160/334] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Oct 26 11:20:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 26 11:20:49.945699 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-67dc8c33-0ebc-4c2b-bb89-18c79c9088f9 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:49.946562 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-67dc8c33-0ebc-4c2b-bb89-18c79c9088f9 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:50.004156 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-67dc8c33-0ebc-4c2b-bb89-18c79c9088f9 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:50.011904 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-67dc8c33-0ebc-4c2b-bb89-18c79c9088f9 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1095 microversion: 2.1 time: 0.070881 Oct 26 11:20:50.012754 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 161/335] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:49 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:50.037307 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-14437cd4-2c4f-4d8e-9f75-9264f212faa6 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:50.044925 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-14437cd4-2c4f-4d8e-9f75-9264f212faa6 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1371 microversion: 2.1 time: 0.158273 Oct 26 11:20:50.045496 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 175/336] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:49 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:20:50.224979 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-5fcf8ad3-e93b-4ef0-ba6c-021b4f4fb559 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:50.225581 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-5fcf8ad3-e93b-4ef0-ba6c-021b4f4fb559 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:50.231485 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5fcf8ad3-e93b-4ef0-ba6c-021b4f4fb559 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:50.231965 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5fcf8ad3-e93b-4ef0-ba6c-021b4f4fb559 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:50.232394 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5fcf8ad3-e93b-4ef0-ba6c-021b4f4fb559 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:50.233099 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5fcf8ad3-e93b-4ef0-ba6c-021b4f4fb559 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:50.233532 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5fcf8ad3-e93b-4ef0-ba6c-021b4f4fb559 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:50.233952 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5fcf8ad3-e93b-4ef0-ba6c-021b4f4fb559 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:50.369095 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-5fcf8ad3-e93b-4ef0-ba6c-021b4f4fb559 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:50.377129 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-5fcf8ad3-e93b-4ef0-ba6c-021b4f4fb559 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 200 len: 1313 microversion: 2.1 time: 0.155998 Oct 26 11:20:50.377695 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 162/337] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:50 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:50.828863 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-61cb101e-0428-4f8c-8cea-4f0fc2e4bde1 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:50.829409 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-61cb101e-0428-4f8c-8cea-4f0fc2e4bde1 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:50.835992 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-61cb101e-0428-4f8c-8cea-4f0fc2e4bde1 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:50.836512 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-61cb101e-0428-4f8c-8cea-4f0fc2e4bde1 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:50.836950 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-61cb101e-0428-4f8c-8cea-4f0fc2e4bde1 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:50.837639 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-61cb101e-0428-4f8c-8cea-4f0fc2e4bde1 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:50.838098 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-61cb101e-0428-4f8c-8cea-4f0fc2e4bde1 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:50.838554 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-61cb101e-0428-4f8c-8cea-4f0fc2e4bde1 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:50.972310 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-61cb101e-0428-4f8c-8cea-4f0fc2e4bde1 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:50.980151 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-61cb101e-0428-4f8c-8cea-4f0fc2e4bde1 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1260 microversion: 2.1 time: 0.155410 Oct 26 11:20:50.980723 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 176/338] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:50 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:51.036299 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-b4fdfaab-9e32-4ba0-a511-857ca18159b5 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:51.036903 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-b4fdfaab-9e32-4ba0-a511-857ca18159b5 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:51.043427 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b4fdfaab-9e32-4ba0-a511-857ca18159b5 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:51.043904 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b4fdfaab-9e32-4ba0-a511-857ca18159b5 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:51.044332 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b4fdfaab-9e32-4ba0-a511-857ca18159b5 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:51.045019 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b4fdfaab-9e32-4ba0-a511-857ca18159b5 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:51.045466 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b4fdfaab-9e32-4ba0-a511-857ca18159b5 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:51.045885 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b4fdfaab-9e32-4ba0-a511-857ca18159b5 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:51.067699 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-31a42936-821e-4076-9f3c-30e4a7f15136 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:51.068319 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-31a42936-821e-4076-9f3c-30e4a7f15136 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:51.074838 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-31a42936-821e-4076-9f3c-30e4a7f15136 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:51.075355 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-31a42936-821e-4076-9f3c-30e4a7f15136 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:51.075797 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-31a42936-821e-4076-9f3c-30e4a7f15136 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:51.076580 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-31a42936-821e-4076-9f3c-30e4a7f15136 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:51.077039 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-31a42936-821e-4076-9f3c-30e4a7f15136 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:51.077469 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-31a42936-821e-4076-9f3c-30e4a7f15136 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:51.106084 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-b4fdfaab-9e32-4ba0-a511-857ca18159b5 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:51.113778 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-b4fdfaab-9e32-4ba0-a511-857ca18159b5 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1145 microversion: 2.1 time: 0.081351 Oct 26 11:20:51.114349 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 163/339] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:51 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:20:51.203713 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-31a42936-821e-4076-9f3c-30e4a7f15136 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:51.211305 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-31a42936-821e-4076-9f3c-30e4a7f15136 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1371 microversion: 2.1 time: 0.147736 Oct 26 11:20:51.211878 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 177/340] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:51 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:20:51.400153 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-f82ad20f-eee7-497b-b756-af2c64d7dc8e tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:51.400767 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-f82ad20f-eee7-497b-b756-af2c64d7dc8e tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:51.406835 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f82ad20f-eee7-497b-b756-af2c64d7dc8e tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:51.407337 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f82ad20f-eee7-497b-b756-af2c64d7dc8e tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:51.407779 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f82ad20f-eee7-497b-b756-af2c64d7dc8e tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:51.408475 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f82ad20f-eee7-497b-b756-af2c64d7dc8e tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:51.408934 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f82ad20f-eee7-497b-b756-af2c64d7dc8e tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:51.409359 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f82ad20f-eee7-497b-b756-af2c64d7dc8e tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:51.536530 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-f82ad20f-eee7-497b-b756-af2c64d7dc8e tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:51.544720 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-f82ad20f-eee7-497b-b756-af2c64d7dc8e tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 200 len: 1313 microversion: 2.1 time: 0.148401 Oct 26 11:20:51.545548 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 164/341] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:51 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:51.784253 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-c0ef5c35-4980-4a4e-b632-1dbfd5f03d25 req-462ca4a3-57df-4022-b599-3c33317123a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b059e78c-afde-4f1f-9a77-b2d6d5aa4e77", "name": "network-vif-plugged", "status": "completed", "tag": "888991fc-f82a-47f3-b3e6-2895c3ae654e"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:20:51.795096 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-c0ef5c35-4980-4a4e-b632-1dbfd5f03d25 req-462ca4a3-57df-4022-b599-3c33317123a0 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:51.795826 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-c0ef5c35-4980-4a4e-b632-1dbfd5f03d25 req-462ca4a3-57df-4022-b599-3c33317123a0 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:51.796481 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-c0ef5c35-4980-4a4e-b632-1dbfd5f03d25 req-462ca4a3-57df-4022-b599-3c33317123a0 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:51.810566 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-c0ef5c35-4980-4a4e-b632-1dbfd5f03d25 req-462ca4a3-57df-4022-b599-3c33317123a0 service nova] Creating event network-vif-plugged:888991fc-f82a-47f3-b3e6-2895c3ae654e for instance b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 on hv-cinder-81558 Oct 26 11:20:51.817622 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-c0ef5c35-4980-4a4e-b632-1dbfd5f03d25 req-462ca4a3-57df-4022-b599-3c33317123a0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036640 Oct 26 11:20:51.818983 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 178/342] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:20:52.002715 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-f9a80218-005e-4efd-9a09-ebb5610a7ded tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:52.003346 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-f9a80218-005e-4efd-9a09-ebb5610a7ded tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:52.009183 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f9a80218-005e-4efd-9a09-ebb5610a7ded tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:52.009699 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f9a80218-005e-4efd-9a09-ebb5610a7ded tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:52.010132 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f9a80218-005e-4efd-9a09-ebb5610a7ded tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:52.010809 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f9a80218-005e-4efd-9a09-ebb5610a7ded tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:52.011299 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f9a80218-005e-4efd-9a09-ebb5610a7ded tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:52.011715 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f9a80218-005e-4efd-9a09-ebb5610a7ded tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:52.137833 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-ea5aedc8-af72-43e0-a1a3-ef8c4bc627dc tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:52.138667 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-ea5aedc8-af72-43e0-a1a3-ef8c4bc627dc tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:52.145119 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ea5aedc8-af72-43e0-a1a3-ef8c4bc627dc tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:52.145635 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ea5aedc8-af72-43e0-a1a3-ef8c4bc627dc tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:52.146076 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ea5aedc8-af72-43e0-a1a3-ef8c4bc627dc tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:52.147453 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ea5aedc8-af72-43e0-a1a3-ef8c4bc627dc tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:52.147617 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-f9a80218-005e-4efd-9a09-ebb5610a7ded tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:52.153460 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ea5aedc8-af72-43e0-a1a3-ef8c4bc627dc tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:52.153460 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ea5aedc8-af72-43e0-a1a3-ef8c4bc627dc tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:52.155218 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-f9a80218-005e-4efd-9a09-ebb5610a7ded tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1260 microversion: 2.1 time: 0.156290 Oct 26 11:20:52.156097 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 165/343] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:51 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:52.215919 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ea5aedc8-af72-43e0-a1a3-ef8c4bc627dc tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:52.223676 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-ea5aedc8-af72-43e0-a1a3-ef8c4bc627dc tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1145 microversion: 2.1 time: 0.090426 Oct 26 11:20:52.224255 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 179/344] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:52 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1145 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:20:52.233306 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-524cbf12-e655-4e38-8066-34599f31de33 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:52.237972 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-524cbf12-e655-4e38-8066-34599f31de33 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:52.240098 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-524cbf12-e655-4e38-8066-34599f31de33 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:52.240581 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-524cbf12-e655-4e38-8066-34599f31de33 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:52.241014 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-524cbf12-e655-4e38-8066-34599f31de33 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:52.241693 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-524cbf12-e655-4e38-8066-34599f31de33 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:52.242144 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-524cbf12-e655-4e38-8066-34599f31de33 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:52.242564 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-524cbf12-e655-4e38-8066-34599f31de33 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:52.391355 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-524cbf12-e655-4e38-8066-34599f31de33 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:52.401473 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-524cbf12-e655-4e38-8066-34599f31de33 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1371 microversion: 2.1 time: 0.171906 Oct 26 11:20:52.402374 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 166/345] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:52 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:52.568361 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-65afca36-8ca1-47c5-ac20-7a04b42ab5d8 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:52.569478 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-65afca36-8ca1-47c5-ac20-7a04b42ab5d8 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:52.575443 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-65afca36-8ca1-47c5-ac20-7a04b42ab5d8 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:52.575928 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-65afca36-8ca1-47c5-ac20-7a04b42ab5d8 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:52.576395 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-65afca36-8ca1-47c5-ac20-7a04b42ab5d8 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:52.577076 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-65afca36-8ca1-47c5-ac20-7a04b42ab5d8 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:52.577520 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-65afca36-8ca1-47c5-ac20-7a04b42ab5d8 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:52.577934 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-65afca36-8ca1-47c5-ac20-7a04b42ab5d8 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:52.708745 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-65afca36-8ca1-47c5-ac20-7a04b42ab5d8 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:52.716399 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-65afca36-8ca1-47c5-ac20-7a04b42ab5d8 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 200 len: 1313 microversion: 2.1 time: 0.152276 Oct 26 11:20:52.716914 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 180/346] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:52 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:53.178369 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-e123a62e-f06b-4841-ab86-6c9316c33167 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:53.179010 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-e123a62e-f06b-4841-ab86-6c9316c33167 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:53.185945 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e123a62e-f06b-4841-ab86-6c9316c33167 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:53.186426 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e123a62e-f06b-4841-ab86-6c9316c33167 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:53.186890 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e123a62e-f06b-4841-ab86-6c9316c33167 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:53.187620 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e123a62e-f06b-4841-ab86-6c9316c33167 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:53.188112 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e123a62e-f06b-4841-ab86-6c9316c33167 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:53.188542 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e123a62e-f06b-4841-ab86-6c9316c33167 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:53.247439 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-ccc4388b-a57a-45bb-ad12-fb91a77e4cf9 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:53.248255 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-ccc4388b-a57a-45bb-ad12-fb91a77e4cf9 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:53.254193 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ccc4388b-a57a-45bb-ad12-fb91a77e4cf9 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:53.254681 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ccc4388b-a57a-45bb-ad12-fb91a77e4cf9 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:53.255150 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ccc4388b-a57a-45bb-ad12-fb91a77e4cf9 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:53.255876 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ccc4388b-a57a-45bb-ad12-fb91a77e4cf9 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:53.256335 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ccc4388b-a57a-45bb-ad12-fb91a77e4cf9 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:53.256763 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ccc4388b-a57a-45bb-ad12-fb91a77e4cf9 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:53.317305 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ccc4388b-a57a-45bb-ad12-fb91a77e4cf9 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:53.322071 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-e123a62e-f06b-4841-ab86-6c9316c33167 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:53.325280 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-ccc4388b-a57a-45bb-ad12-fb91a77e4cf9 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1145 microversion: 2.1 time: 0.082416 Oct 26 11:20:53.325879 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 181/347] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:53 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:20:53.329640 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-e123a62e-f06b-4841-ab86-6c9316c33167 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1260 microversion: 2.1 time: 0.155206 Oct 26 11:20:53.330197 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 167/348] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:53 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:53.423647 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-ff0e0745-fb38-4adc-8002-596ed62d84da tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:53.424257 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-ff0e0745-fb38-4adc-8002-596ed62d84da tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:53.430179 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ff0e0745-fb38-4adc-8002-596ed62d84da tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:53.430670 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ff0e0745-fb38-4adc-8002-596ed62d84da tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:53.431137 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ff0e0745-fb38-4adc-8002-596ed62d84da tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:53.431824 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ff0e0745-fb38-4adc-8002-596ed62d84da tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:53.432282 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ff0e0745-fb38-4adc-8002-596ed62d84da tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:53.432708 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ff0e0745-fb38-4adc-8002-596ed62d84da tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:53.561610 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ff0e0745-fb38-4adc-8002-596ed62d84da tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:53.571850 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-ff0e0745-fb38-4adc-8002-596ed62d84da tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1371 microversion: 2.1 time: 0.149960 Oct 26 11:20:53.571850 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 182/349] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:53 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:53.739546 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-d34fde83-6a06-4c77-935f-b183c2d87835 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:53.740159 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-d34fde83-6a06-4c77-935f-b183c2d87835 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:53.746497 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d34fde83-6a06-4c77-935f-b183c2d87835 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:53.747491 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d34fde83-6a06-4c77-935f-b183c2d87835 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:53.748291 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d34fde83-6a06-4c77-935f-b183c2d87835 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:53.748291 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d34fde83-6a06-4c77-935f-b183c2d87835 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:53.748807 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d34fde83-6a06-4c77-935f-b183c2d87835 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:53.749230 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d34fde83-6a06-4c77-935f-b183c2d87835 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:53.835224 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-8781b6f5-c77a-437d-8297-cc571775d5ed req-a1c1d3c1-706d-4996-b0e5-d90b135aba8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4b20a22-cb3b-4fb4-8b69-3b626cd6d991", "name": "network-vif-plugged", "status": "completed", "tag": "de570ff5-446d-40b7-add4-d927b658a166"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:20:53.845335 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-8781b6f5-c77a-437d-8297-cc571775d5ed req-a1c1d3c1-706d-4996-b0e5-d90b135aba8a service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:53.845806 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-8781b6f5-c77a-437d-8297-cc571775d5ed req-a1c1d3c1-706d-4996-b0e5-d90b135aba8a service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:53.846233 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-8781b6f5-c77a-437d-8297-cc571775d5ed req-a1c1d3c1-706d-4996-b0e5-d90b135aba8a service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:53.857427 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-8781b6f5-c77a-437d-8297-cc571775d5ed req-a1c1d3c1-706d-4996-b0e5-d90b135aba8a service nova] Creating event network-vif-plugged:de570ff5-446d-40b7-add4-d927b658a166 for instance e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 on hv-cinder-81558 Oct 26 11:20:53.862402 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-8781b6f5-c77a-437d-8297-cc571775d5ed req-a1c1d3c1-706d-4996-b0e5-d90b135aba8a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030763 Oct 26 11:20:53.863027 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 183/350] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:20:53.881291 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-d34fde83-6a06-4c77-935f-b183c2d87835 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:53.889553 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-d34fde83-6a06-4c77-935f-b183c2d87835 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 200 len: 1313 microversion: 2.1 time: 0.153978 Oct 26 11:20:53.890131 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 168/351] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:53 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:54.358105 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-f852980d-c36a-4ad3-89a6-b70949af1d10 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:54.358105 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-f852980d-c36a-4ad3-89a6-b70949af1d10 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:54.358602 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-36c08637-119f-4e3e-bfc2-d3f37e77d77e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:54.358602 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-36c08637-119f-4e3e-bfc2-d3f37e77d77e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:54.359080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f852980d-c36a-4ad3-89a6-b70949af1d10 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:54.359080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f852980d-c36a-4ad3-89a6-b70949af1d10 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:54.359080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f852980d-c36a-4ad3-89a6-b70949af1d10 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:54.359080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f852980d-c36a-4ad3-89a6-b70949af1d10 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:54.359408 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f852980d-c36a-4ad3-89a6-b70949af1d10 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:54.359408 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f852980d-c36a-4ad3-89a6-b70949af1d10 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:54.360047 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-36c08637-119f-4e3e-bfc2-d3f37e77d77e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:54.360527 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-36c08637-119f-4e3e-bfc2-d3f37e77d77e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:54.360967 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-36c08637-119f-4e3e-bfc2-d3f37e77d77e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:54.361651 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-36c08637-119f-4e3e-bfc2-d3f37e77d77e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:54.362105 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-36c08637-119f-4e3e-bfc2-d3f37e77d77e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:54.362526 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=100 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:20:54.362610 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-36c08637-119f-4e3e-bfc2-d3f37e77d77e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:54.366596 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=100 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:20:54.420843 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-f852980d-c36a-4ad3-89a6-b70949af1d10 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:54.429063 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-f852980d-c36a-4ad3-89a6-b70949af1d10 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1137 microversion: 2.1 time: 0.083926 Oct 26 11:20:54.429799 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 184/352] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:54 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1137 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:54.519064 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-36c08637-119f-4e3e-bfc2-d3f37e77d77e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:54.520703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-36c08637-119f-4e3e-bfc2-d3f37e77d77e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1260 microversion: 2.1 time: 0.171933 Oct 26 11:20:54.521279 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 169/353] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:54 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:54.592203 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-096c5401-bb2f-442d-b75e-161a49c81a07 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:54.592804 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-096c5401-bb2f-442d-b75e-161a49c81a07 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:54.598534 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-096c5401-bb2f-442d-b75e-161a49c81a07 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:54.599053 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-096c5401-bb2f-442d-b75e-161a49c81a07 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:54.599487 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-096c5401-bb2f-442d-b75e-161a49c81a07 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:54.600169 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-096c5401-bb2f-442d-b75e-161a49c81a07 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:54.600614 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-096c5401-bb2f-442d-b75e-161a49c81a07 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:54.601030 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-096c5401-bb2f-442d-b75e-161a49c81a07 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:54.730296 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-096c5401-bb2f-442d-b75e-161a49c81a07 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:54.737982 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-096c5401-bb2f-442d-b75e-161a49c81a07 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1371 microversion: 2.1 time: 0.149628 Oct 26 11:20:54.738549 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 185/354] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:54 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:54.913526 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-4817c4e6-bc5d-4e50-b2a3-365a921088c5 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:54.914415 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-4817c4e6-bc5d-4e50-b2a3-365a921088c5 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:54.920912 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4817c4e6-bc5d-4e50-b2a3-365a921088c5 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:54.921404 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4817c4e6-bc5d-4e50-b2a3-365a921088c5 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:54.921848 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4817c4e6-bc5d-4e50-b2a3-365a921088c5 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:54.922540 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4817c4e6-bc5d-4e50-b2a3-365a921088c5 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:54.923026 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4817c4e6-bc5d-4e50-b2a3-365a921088c5 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:54.923452 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4817c4e6-bc5d-4e50-b2a3-365a921088c5 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:55.053916 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-4817c4e6-bc5d-4e50-b2a3-365a921088c5 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:55.062386 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-4817c4e6-bc5d-4e50-b2a3-365a921088c5 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 200 len: 1313 microversion: 2.1 time: 0.152026 Oct 26 11:20:55.062386 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 170/355] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:54 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:55.453141 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e2a99c35-cf04-421b-b147-5c30aa945597 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:55.453747 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-e2a99c35-cf04-421b-b147-5c30aa945597 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:55.459519 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2a99c35-cf04-421b-b147-5c30aa945597 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:55.459995 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2a99c35-cf04-421b-b147-5c30aa945597 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:55.460423 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2a99c35-cf04-421b-b147-5c30aa945597 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:55.461098 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2a99c35-cf04-421b-b147-5c30aa945597 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:55.461570 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2a99c35-cf04-421b-b147-5c30aa945597 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:55.462522 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2a99c35-cf04-421b-b147-5c30aa945597 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:55.521267 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-e2a99c35-cf04-421b-b147-5c30aa945597 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:55.529240 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-e2a99c35-cf04-421b-b147-5c30aa945597 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1193 microversion: 2.1 time: 0.079970 Oct 26 11:20:55.529802 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 186/356] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:55 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1193 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:55.543229 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-2702f5ce-395b-4a81-adb1-8271889bc818 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:55.543829 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-2702f5ce-395b-4a81-adb1-8271889bc818 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:55.550121 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2702f5ce-395b-4a81-adb1-8271889bc818 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:55.550601 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2702f5ce-395b-4a81-adb1-8271889bc818 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:55.551072 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2702f5ce-395b-4a81-adb1-8271889bc818 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:55.551777 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2702f5ce-395b-4a81-adb1-8271889bc818 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:55.552244 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2702f5ce-395b-4a81-adb1-8271889bc818 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:55.552643 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2702f5ce-395b-4a81-adb1-8271889bc818 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:55.684385 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-2702f5ce-395b-4a81-adb1-8271889bc818 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:55.692520 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-2702f5ce-395b-4a81-adb1-8271889bc818 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1260 microversion: 2.1 time: 0.153062 Oct 26 11:20:55.693092 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 171/357] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:55 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:55.762185 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-bf9b4ca9-7615-47e9-aefa-2cf1f17eb331 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:55.762904 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-bf9b4ca9-7615-47e9-aefa-2cf1f17eb331 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:55.768666 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bf9b4ca9-7615-47e9-aefa-2cf1f17eb331 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:55.769178 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bf9b4ca9-7615-47e9-aefa-2cf1f17eb331 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:55.769614 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bf9b4ca9-7615-47e9-aefa-2cf1f17eb331 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:55.770303 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bf9b4ca9-7615-47e9-aefa-2cf1f17eb331 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:55.770758 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bf9b4ca9-7615-47e9-aefa-2cf1f17eb331 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:55.771202 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bf9b4ca9-7615-47e9-aefa-2cf1f17eb331 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:55.900840 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-bf9b4ca9-7615-47e9-aefa-2cf1f17eb331 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:55.908714 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-bf9b4ca9-7615-47e9-aefa-2cf1f17eb331 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1371 microversion: 2.1 time: 0.151007 Oct 26 11:20:55.909297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 187/358] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:55 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:56.084518 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-6215badb-287e-4923-8e3c-173eadaea64b tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:56.085126 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-6215badb-287e-4923-8e3c-173eadaea64b tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:56.093350 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6215badb-287e-4923-8e3c-173eadaea64b tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:56.093350 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6215badb-287e-4923-8e3c-173eadaea64b tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:56.093350 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6215badb-287e-4923-8e3c-173eadaea64b tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:56.093350 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6215badb-287e-4923-8e3c-173eadaea64b tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:56.093693 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6215badb-287e-4923-8e3c-173eadaea64b tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:56.093693 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6215badb-287e-4923-8e3c-173eadaea64b tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:56.218786 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-6215badb-287e-4923-8e3c-173eadaea64b tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:56.226354 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-6215badb-287e-4923-8e3c-173eadaea64b tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 200 len: 1313 microversion: 2.1 time: 0.145627 Oct 26 11:20:56.226935 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 172/359] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:56 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:56.551814 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-66c96984-1433-4986-9d78-4daacdce0e91 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:56.552357 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-66c96984-1433-4986-9d78-4daacdce0e91 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:56.558217 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-66c96984-1433-4986-9d78-4daacdce0e91 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:56.558690 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-66c96984-1433-4986-9d78-4daacdce0e91 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:56.559146 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-66c96984-1433-4986-9d78-4daacdce0e91 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:56.559820 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-66c96984-1433-4986-9d78-4daacdce0e91 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:56.560268 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-66c96984-1433-4986-9d78-4daacdce0e91 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:56.560685 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-66c96984-1433-4986-9d78-4daacdce0e91 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:56.619840 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-66c96984-1433-4986-9d78-4daacdce0e91 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:56.627126 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-66c96984-1433-4986-9d78-4daacdce0e91 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1193 microversion: 2.1 time: 0.079173 Oct 26 11:20:56.627689 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 188/360] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:56 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1193 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:56.716796 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-84131ab5-afff-403d-b10e-303212cff0aa tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:56.717408 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-84131ab5-afff-403d-b10e-303212cff0aa tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:56.723794 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-84131ab5-afff-403d-b10e-303212cff0aa tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:56.724280 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-84131ab5-afff-403d-b10e-303212cff0aa tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:56.724719 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-84131ab5-afff-403d-b10e-303212cff0aa tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:56.725421 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-84131ab5-afff-403d-b10e-303212cff0aa tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:56.725875 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-84131ab5-afff-403d-b10e-303212cff0aa tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:56.726298 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-84131ab5-afff-403d-b10e-303212cff0aa tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:56.858128 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-84131ab5-afff-403d-b10e-303212cff0aa tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:56.865687 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-84131ab5-afff-403d-b10e-303212cff0aa tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1260 microversion: 2.1 time: 0.153366 Oct 26 11:20:56.866251 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 173/361] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:56 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:56.931762 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-fcfe204b-09f2-4232-92b1-d02409b9a3a7 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:56.932371 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-fcfe204b-09f2-4232-92b1-d02409b9a3a7 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:56.938153 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fcfe204b-09f2-4232-92b1-d02409b9a3a7 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:56.938635 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fcfe204b-09f2-4232-92b1-d02409b9a3a7 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:56.939177 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fcfe204b-09f2-4232-92b1-d02409b9a3a7 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:56.940117 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fcfe204b-09f2-4232-92b1-d02409b9a3a7 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:56.940568 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fcfe204b-09f2-4232-92b1-d02409b9a3a7 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:56.940991 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fcfe204b-09f2-4232-92b1-d02409b9a3a7 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:57.063434 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-fcfe204b-09f2-4232-92b1-d02409b9a3a7 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:57.071168 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-fcfe204b-09f2-4232-92b1-d02409b9a3a7 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1371 microversion: 2.1 time: 0.143224 Oct 26 11:20:57.072313 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 189/362] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:56 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1371 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:57.249782 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-c62f103f-2cd8-4048-8f09-58c9920381ae tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:57.250387 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-c62f103f-2cd8-4048-8f09-58c9920381ae tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:57.256205 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c62f103f-2cd8-4048-8f09-58c9920381ae tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:57.256680 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c62f103f-2cd8-4048-8f09-58c9920381ae tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:57.257107 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c62f103f-2cd8-4048-8f09-58c9920381ae tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:57.257785 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c62f103f-2cd8-4048-8f09-58c9920381ae tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:57.258236 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c62f103f-2cd8-4048-8f09-58c9920381ae tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:57.258654 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c62f103f-2cd8-4048-8f09-58c9920381ae tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:57.381782 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-c62f103f-2cd8-4048-8f09-58c9920381ae tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:57.390213 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-c62f103f-2cd8-4048-8f09-58c9920381ae tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 200 len: 1313 microversion: 2.1 time: 0.144194 Oct 26 11:20:57.390779 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 174/363] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:57 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 1313 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:57.649518 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-f4d50759-8c57-44e7-b14a-4bc260bfb048 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:57.650129 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-f4d50759-8c57-44e7-b14a-4bc260bfb048 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:57.656107 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f4d50759-8c57-44e7-b14a-4bc260bfb048 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:57.656583 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f4d50759-8c57-44e7-b14a-4bc260bfb048 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:57.657015 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f4d50759-8c57-44e7-b14a-4bc260bfb048 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:57.657693 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f4d50759-8c57-44e7-b14a-4bc260bfb048 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:57.658145 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f4d50759-8c57-44e7-b14a-4bc260bfb048 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:57.658559 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f4d50759-8c57-44e7-b14a-4bc260bfb048 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:57.720423 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-f4d50759-8c57-44e7-b14a-4bc260bfb048 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:57.729073 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-f4d50759-8c57-44e7-b14a-4bc260bfb048 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1193 microversion: 2.1 time: 0.083339 Oct 26 11:20:57.729640 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 190/364] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:57 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1193 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:57.888141 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-119da9e0-39f8-4a1e-a156-b9620faae6ff tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:57.888746 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-119da9e0-39f8-4a1e-a156-b9620faae6ff tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:57.895116 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-119da9e0-39f8-4a1e-a156-b9620faae6ff tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:57.895595 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-119da9e0-39f8-4a1e-a156-b9620faae6ff tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:57.896025 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-119da9e0-39f8-4a1e-a156-b9620faae6ff tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:57.896703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-119da9e0-39f8-4a1e-a156-b9620faae6ff tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:57.897153 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-119da9e0-39f8-4a1e-a156-b9620faae6ff tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:57.897571 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-119da9e0-39f8-4a1e-a156-b9620faae6ff tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:58.024010 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-119da9e0-39f8-4a1e-a156-b9620faae6ff tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:58.032040 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-119da9e0-39f8-4a1e-a156-b9620faae6ff tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1260 microversion: 2.1 time: 0.147800 Oct 26 11:20:58.032605 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 175/365] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:57 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:58.094040 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-75c01389-c094-48e3-a85c-0c23437a52c4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:58.094645 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-75c01389-c094-48e3-a85c-0c23437a52c4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:58.100563 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-75c01389-c094-48e3-a85c-0c23437a52c4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:58.101039 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-75c01389-c094-48e3-a85c-0c23437a52c4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:58.101467 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-75c01389-c094-48e3-a85c-0c23437a52c4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:58.102146 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-75c01389-c094-48e3-a85c-0c23437a52c4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:58.102658 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-75c01389-c094-48e3-a85c-0c23437a52c4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:58.103599 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-75c01389-c094-48e3-a85c-0c23437a52c4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:58.234188 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-75c01389-c094-48e3-a85c-0c23437a52c4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:58.241906 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-75c01389-c094-48e3-a85c-0c23437a52c4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1371 microversion: 2.1 time: 0.151648 Oct 26 11:20:58.242531 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 191/366] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:58 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:58.413053 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-8eb2e658-3e8d-4734-9214-f00f527587ac tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:58.413687 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-8eb2e658-3e8d-4734-9214-f00f527587ac tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:58.419534 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8eb2e658-3e8d-4734-9214-f00f527587ac tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:58.420009 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8eb2e658-3e8d-4734-9214-f00f527587ac tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:58.420437 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8eb2e658-3e8d-4734-9214-f00f527587ac tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:58.421111 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8eb2e658-3e8d-4734-9214-f00f527587ac tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:58.421559 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8eb2e658-3e8d-4734-9214-f00f527587ac tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:58.421976 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8eb2e658-3e8d-4734-9214-f00f527587ac tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:58.547888 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-8eb2e658-3e8d-4734-9214-f00f527587ac tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:58.555285 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-8eb2e658-3e8d-4734-9214-f00f527587ac tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 200 len: 1313 microversion: 2.1 time: 0.146067 Oct 26 11:20:58.556528 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 176/367] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:58 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:58.752531 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-9864344e-5c3f-47e6-9212-c6bf7a147c66 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:58.753090 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-9864344e-5c3f-47e6-9212-c6bf7a147c66 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:58.759744 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9864344e-5c3f-47e6-9212-c6bf7a147c66 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:58.760219 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9864344e-5c3f-47e6-9212-c6bf7a147c66 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:58.760651 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9864344e-5c3f-47e6-9212-c6bf7a147c66 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:58.761327 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9864344e-5c3f-47e6-9212-c6bf7a147c66 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:58.761769 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9864344e-5c3f-47e6-9212-c6bf7a147c66 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:58.762184 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9864344e-5c3f-47e6-9212-c6bf7a147c66 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:58.822182 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-9864344e-5c3f-47e6-9212-c6bf7a147c66 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:58.829891 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-9864344e-5c3f-47e6-9212-c6bf7a147c66 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1193 microversion: 2.1 time: 0.081389 Oct 26 11:20:58.830456 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 192/368] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:58 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1193 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:59.054955 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-4bf77afe-a5ce-48c0-b0ca-7e29e7fe1a45 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:59.055524 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-4bf77afe-a5ce-48c0-b0ca-7e29e7fe1a45 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:59.062497 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4bf77afe-a5ce-48c0-b0ca-7e29e7fe1a45 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:59.063008 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4bf77afe-a5ce-48c0-b0ca-7e29e7fe1a45 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:59.063444 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4bf77afe-a5ce-48c0-b0ca-7e29e7fe1a45 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:59.064125 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4bf77afe-a5ce-48c0-b0ca-7e29e7fe1a45 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:59.064589 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4bf77afe-a5ce-48c0-b0ca-7e29e7fe1a45 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:59.065261 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4bf77afe-a5ce-48c0-b0ca-7e29e7fe1a45 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:59.191408 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-4bf77afe-a5ce-48c0-b0ca-7e29e7fe1a45 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:59.199063 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-4bf77afe-a5ce-48c0-b0ca-7e29e7fe1a45 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1260 microversion: 2.1 time: 0.148013 Oct 26 11:20:59.199624 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 177/369] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:59 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:59.264828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-40094db0-2034-4462-9e56-090637ab9a8b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:59.265464 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-40094db0-2034-4462-9e56-090637ab9a8b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:59.271354 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-40094db0-2034-4462-9e56-090637ab9a8b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:59.271839 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-40094db0-2034-4462-9e56-090637ab9a8b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:59.272275 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-40094db0-2034-4462-9e56-090637ab9a8b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:59.272960 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-40094db0-2034-4462-9e56-090637ab9a8b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:59.273438 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-40094db0-2034-4462-9e56-090637ab9a8b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:59.273858 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-40094db0-2034-4462-9e56-090637ab9a8b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:59.400673 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-40094db0-2034-4462-9e56-090637ab9a8b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:59.408175 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-40094db0-2034-4462-9e56-090637ab9a8b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1371 microversion: 2.1 time: 0.147178 Oct 26 11:20:59.408739 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 193/370] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:59 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:59.578593 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-2bd1f390-4b79-4d2d-ae3e-c6e94fef46d1 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:59.579243 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-2bd1f390-4b79-4d2d-ae3e-c6e94fef46d1 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:59.581096 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell0:SELECT=2 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:20:59.585776 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2bd1f390-4b79-4d2d-ae3e-c6e94fef46d1 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:59.586259 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2bd1f390-4b79-4d2d-ae3e-c6e94fef46d1 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:59.586692 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2bd1f390-4b79-4d2d-ae3e-c6e94fef46d1 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:59.587893 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2bd1f390-4b79-4d2d-ae3e-c6e94fef46d1 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:59.588378 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2bd1f390-4b79-4d2d-ae3e-c6e94fef46d1 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:59.588800 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2bd1f390-4b79-4d2d-ae3e-c6e94fef46d1 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:59.718527 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-2bd1f390-4b79-4d2d-ae3e-c6e94fef46d1 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:59.726242 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-2bd1f390-4b79-4d2d-ae3e-c6e94fef46d1 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 200 len: 1313 microversion: 2.1 time: 0.151403 Oct 26 11:20:59.726838 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 178/371] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:59 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:20:59.853091 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-13c08a15-80d3-4ae9-8482-cc3aca7169d1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:20:59.853740 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-13c08a15-80d3-4ae9-8482-cc3aca7169d1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:20:59.859832 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-13c08a15-80d3-4ae9-8482-cc3aca7169d1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:59.860312 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-13c08a15-80d3-4ae9-8482-cc3aca7169d1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:59.860743 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-13c08a15-80d3-4ae9-8482-cc3aca7169d1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:59.861423 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-13c08a15-80d3-4ae9-8482-cc3aca7169d1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:20:59.861871 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-13c08a15-80d3-4ae9-8482-cc3aca7169d1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:20:59.862289 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-13c08a15-80d3-4ae9-8482-cc3aca7169d1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:20:59.922347 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-13c08a15-80d3-4ae9-8482-cc3aca7169d1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:20:59.930089 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-13c08a15-80d3-4ae9-8482-cc3aca7169d1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1193 microversion: 2.1 time: 0.081156 Oct 26 11:20:59.930657 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 194/372] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:20:59 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1193 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:00.221513 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-5a4b6e1b-73f1-402a-aac7-7a65f3fdb127 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:00.222061 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-5a4b6e1b-73f1-402a-aac7-7a65f3fdb127 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:00.223896 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell0:SELECT=8 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:21:00.229118 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5a4b6e1b-73f1-402a-aac7-7a65f3fdb127 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:00.229595 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5a4b6e1b-73f1-402a-aac7-7a65f3fdb127 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:00.230029 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5a4b6e1b-73f1-402a-aac7-7a65f3fdb127 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:00.230709 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5a4b6e1b-73f1-402a-aac7-7a65f3fdb127 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:00.231182 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5a4b6e1b-73f1-402a-aac7-7a65f3fdb127 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:00.231602 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5a4b6e1b-73f1-402a-aac7-7a65f3fdb127 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:00.358072 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-5a4b6e1b-73f1-402a-aac7-7a65f3fdb127 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:00.365572 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-5a4b6e1b-73f1-402a-aac7-7a65f3fdb127 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1260 microversion: 2.1 time: 0.147950 Oct 26 11:21:00.366131 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 179/373] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:00 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:00.430750 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-de0f2572-c266-4411-a6b5-5f0bc72c5d82 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:00.432060 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-de0f2572-c266-4411-a6b5-5f0bc72c5d82 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:00.437880 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-de0f2572-c266-4411-a6b5-5f0bc72c5d82 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:00.438510 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-de0f2572-c266-4411-a6b5-5f0bc72c5d82 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:00.438971 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-de0f2572-c266-4411-a6b5-5f0bc72c5d82 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:00.439651 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-de0f2572-c266-4411-a6b5-5f0bc72c5d82 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:00.440351 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-de0f2572-c266-4411-a6b5-5f0bc72c5d82 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:00.440768 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-de0f2572-c266-4411-a6b5-5f0bc72c5d82 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:00.563263 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-de0f2572-c266-4411-a6b5-5f0bc72c5d82 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:00.570939 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-de0f2572-c266-4411-a6b5-5f0bc72c5d82 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1371 microversion: 2.1 time: 0.143941 Oct 26 11:21:00.571508 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 195/374] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:00 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1371 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:00.749690 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-7b97e941-0882-497f-a734-4f5c6f28ac6f tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:00.750303 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-7b97e941-0882-497f-a734-4f5c6f28ac6f tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:00.756267 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7b97e941-0882-497f-a734-4f5c6f28ac6f tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:00.756748 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7b97e941-0882-497f-a734-4f5c6f28ac6f tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:00.757182 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7b97e941-0882-497f-a734-4f5c6f28ac6f tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:00.757870 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7b97e941-0882-497f-a734-4f5c6f28ac6f tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:00.758321 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7b97e941-0882-497f-a734-4f5c6f28ac6f tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:00.758745 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7b97e941-0882-497f-a734-4f5c6f28ac6f tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:00.894530 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-7b97e941-0882-497f-a734-4f5c6f28ac6f tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:00.903044 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-7b97e941-0882-497f-a734-4f5c6f28ac6f tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 200 len: 1313 microversion: 2.1 time: 0.157176 Oct 26 11:21:00.903610 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 180/375] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:00 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:00.952806 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-77d186ba-5e49-4a0c-a50a-a3e9dc10cc44 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:00.953424 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-77d186ba-5e49-4a0c-a50a-a3e9dc10cc44 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:00.959259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-77d186ba-5e49-4a0c-a50a-a3e9dc10cc44 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:00.959808 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-77d186ba-5e49-4a0c-a50a-a3e9dc10cc44 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:00.960244 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-77d186ba-5e49-4a0c-a50a-a3e9dc10cc44 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:00.960936 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-77d186ba-5e49-4a0c-a50a-a3e9dc10cc44 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:00.961393 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-77d186ba-5e49-4a0c-a50a-a3e9dc10cc44 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:00.961820 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-77d186ba-5e49-4a0c-a50a-a3e9dc10cc44 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:01.021867 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-77d186ba-5e49-4a0c-a50a-a3e9dc10cc44 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:01.030080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-77d186ba-5e49-4a0c-a50a-a3e9dc10cc44 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1193 microversion: 2.1 time: 0.081193 Oct 26 11:21:01.030649 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 196/376] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:00 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1193 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:01.389074 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-c35e0c6f-9ae1-4d63-a1ed-64fab7e52359 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:01.389695 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-c35e0c6f-9ae1-4d63-a1ed-64fab7e52359 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:01.396414 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c35e0c6f-9ae1-4d63-a1ed-64fab7e52359 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:01.396905 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c35e0c6f-9ae1-4d63-a1ed-64fab7e52359 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:01.405062 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c35e0c6f-9ae1-4d63-a1ed-64fab7e52359 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:01.405062 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c35e0c6f-9ae1-4d63-a1ed-64fab7e52359 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:01.405062 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c35e0c6f-9ae1-4d63-a1ed-64fab7e52359 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:01.405062 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c35e0c6f-9ae1-4d63-a1ed-64fab7e52359 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:01.534866 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-c35e0c6f-9ae1-4d63-a1ed-64fab7e52359 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:01.542445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-c35e0c6f-9ae1-4d63-a1ed-64fab7e52359 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1260 microversion: 2.1 time: 0.157831 Oct 26 11:21:01.543094 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 181/377] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:01 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:01.593494 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-76c8c424-66df-426c-beb1-fef501ee03b5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:01.594029 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-76c8c424-66df-426c-beb1-fef501ee03b5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:01.600165 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-76c8c424-66df-426c-beb1-fef501ee03b5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:01.600750 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-76c8c424-66df-426c-beb1-fef501ee03b5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:01.601889 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-76c8c424-66df-426c-beb1-fef501ee03b5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:01.602782 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-76c8c424-66df-426c-beb1-fef501ee03b5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:01.603298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-76c8c424-66df-426c-beb1-fef501ee03b5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:01.603725 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-76c8c424-66df-426c-beb1-fef501ee03b5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:01.739876 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-76c8c424-66df-426c-beb1-fef501ee03b5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:01.748637 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-76c8c424-66df-426c-beb1-fef501ee03b5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1371 microversion: 2.1 time: 0.158785 Oct 26 11:21:01.749216 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 197/378] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:01 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:01.926479 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-fe3fbe71-3e17-4815-aeae-c0a38e14265f tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:01.927139 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-fe3fbe71-3e17-4815-aeae-c0a38e14265f tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:01.933707 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fe3fbe71-3e17-4815-aeae-c0a38e14265f tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:01.934225 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fe3fbe71-3e17-4815-aeae-c0a38e14265f tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:01.934669 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fe3fbe71-3e17-4815-aeae-c0a38e14265f tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:01.935390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fe3fbe71-3e17-4815-aeae-c0a38e14265f tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:01.935846 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fe3fbe71-3e17-4815-aeae-c0a38e14265f tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:01.936275 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fe3fbe71-3e17-4815-aeae-c0a38e14265f tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:02.054840 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-42d3767b-c311-4628-a1cd-769a3206436a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:02.055942 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-42d3767b-c311-4628-a1cd-769a3206436a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:02.063324 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-42d3767b-c311-4628-a1cd-769a3206436a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:02.063816 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-42d3767b-c311-4628-a1cd-769a3206436a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:02.063992 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-fe3fbe71-3e17-4815-aeae-c0a38e14265f tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:02.064250 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-42d3767b-c311-4628-a1cd-769a3206436a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:02.064938 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-42d3767b-c311-4628-a1cd-769a3206436a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:02.065980 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-42d3767b-c311-4628-a1cd-769a3206436a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:02.066473 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-42d3767b-c311-4628-a1cd-769a3206436a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:02.075871 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-fe3fbe71-3e17-4815-aeae-c0a38e14265f tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 200 len: 1497 microversion: 2.1 time: 0.153149 Oct 26 11:21:02.076508 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 182/379] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:01 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:02.131113 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-42d3767b-c311-4628-a1cd-769a3206436a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:02.139863 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-42d3767b-c311-4628-a1cd-769a3206436a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1193 microversion: 2.1 time: 0.090455 Oct 26 11:21:02.140429 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 198/380] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:02 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1193 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:21:02.261589 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-9dd7512e-71c6-4863-b513-5ba76d81c21d req-739ff16b-4de5-42b7-ac39-b75c36e252a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "975e97a1-fe2c-4f81-88b5-274a052109c6", "name": "network-vif-plugged", "status": "completed", "tag": "aa03144d-b19b-4e5d-8027-1ca2393de35d"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:21:02.271154 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-9dd7512e-71c6-4863-b513-5ba76d81c21d req-739ff16b-4de5-42b7-ac39-b75c36e252a6 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:02.271635 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-9dd7512e-71c6-4863-b513-5ba76d81c21d req-739ff16b-4de5-42b7-ac39-b75c36e252a6 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:02.272064 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-9dd7512e-71c6-4863-b513-5ba76d81c21d req-739ff16b-4de5-42b7-ac39-b75c36e252a6 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:02.283802 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-9dd7512e-71c6-4863-b513-5ba76d81c21d req-739ff16b-4de5-42b7-ac39-b75c36e252a6 service nova] Creating event network-vif-plugged:aa03144d-b19b-4e5d-8027-1ca2393de35d for instance 975e97a1-fe2c-4f81-88b5-274a052109c6 on hv-cinder-81558 Oct 26 11:21:02.288803 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-9dd7512e-71c6-4863-b513-5ba76d81c21d req-739ff16b-4de5-42b7-ac39-b75c36e252a6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030997 Oct 26 11:21:02.289380 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 183/381] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:21:02.565631 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-ab7e7844-8027-4f29-9c2b-bc137f1f835f tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:02.566316 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-ab7e7844-8027-4f29-9c2b-bc137f1f835f tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:02.568244 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=100 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:21:02.572882 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ab7e7844-8027-4f29-9c2b-bc137f1f835f tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:02.573376 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ab7e7844-8027-4f29-9c2b-bc137f1f835f tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:02.573819 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ab7e7844-8027-4f29-9c2b-bc137f1f835f tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:02.574716 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ab7e7844-8027-4f29-9c2b-bc137f1f835f tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:02.575194 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ab7e7844-8027-4f29-9c2b-bc137f1f835f tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:02.578918 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ab7e7844-8027-4f29-9c2b-bc137f1f835f tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:02.719852 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ab7e7844-8027-4f29-9c2b-bc137f1f835f tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:02.728973 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-ab7e7844-8027-4f29-9c2b-bc137f1f835f tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1444 microversion: 2.1 time: 0.167346 Oct 26 11:21:02.730170 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 199/382] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:02 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1444 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:02.753281 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-88a63a16-8901-4cff-a27b-f58d972082d1 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:02.754119 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-88a63a16-8901-4cff-a27b-f58d972082d1 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:02.760907 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-88a63a16-8901-4cff-a27b-f58d972082d1 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:02.761393 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-88a63a16-8901-4cff-a27b-f58d972082d1 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:02.761822 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-88a63a16-8901-4cff-a27b-f58d972082d1 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:02.762509 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-88a63a16-8901-4cff-a27b-f58d972082d1 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:02.763204 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-88a63a16-8901-4cff-a27b-f58d972082d1 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:02.763626 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-88a63a16-8901-4cff-a27b-f58d972082d1 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:02.772056 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-45339208-6171-466d-aa67-53c40e18961c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:02.775895 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-45339208-6171-466d-aa67-53c40e18961c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:02.780001 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-45339208-6171-466d-aa67-53c40e18961c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:02.780525 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-45339208-6171-466d-aa67-53c40e18961c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:02.780968 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-45339208-6171-466d-aa67-53c40e18961c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:02.781725 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-45339208-6171-466d-aa67-53c40e18961c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:02.782159 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-45339208-6171-466d-aa67-53c40e18961c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:02.782593 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-45339208-6171-466d-aa67-53c40e18961c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:02.920190 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-45339208-6171-466d-aa67-53c40e18961c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:02.925415 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=100 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:21:02.930024 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-45339208-6171-466d-aa67-53c40e18961c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1371 microversion: 2.1 time: 0.161833 Oct 26 11:21:02.930713 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 200/383] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:02 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:21:02.973885 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-88a63a16-8901-4cff-a27b-f58d972082d1 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:02.984314 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-88a63a16-8901-4cff-a27b-f58d972082d1 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1444 microversion: 2.1 time: 0.233028 Oct 26 11:21:02.984314 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 184/384] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:02 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1444 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:03.129067 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-614bcf9a-0d7f-4fe3-8281-acc8aa2e62b7 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:03.129607 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-614bcf9a-0d7f-4fe3-8281-acc8aa2e62b7 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:03.136326 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-614bcf9a-0d7f-4fe3-8281-acc8aa2e62b7 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:03.136802 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-614bcf9a-0d7f-4fe3-8281-acc8aa2e62b7 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:03.137237 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-614bcf9a-0d7f-4fe3-8281-acc8aa2e62b7 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:03.137924 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-614bcf9a-0d7f-4fe3-8281-acc8aa2e62b7 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:03.138377 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-614bcf9a-0d7f-4fe3-8281-acc8aa2e62b7 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:03.138797 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-614bcf9a-0d7f-4fe3-8281-acc8aa2e62b7 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:03.163277 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-6fa5674a-5358-48f2-9293-e8849d5ce96e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:03.163930 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-6fa5674a-5358-48f2-9293-e8849d5ce96e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:03.170679 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-614bcf9a-0d7f-4fe3-8281-acc8aa2e62b7 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Going to try to terminate instance {{(pid=119306) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 11:21:03.170808 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6fa5674a-5358-48f2-9293-e8849d5ce96e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:03.170808 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6fa5674a-5358-48f2-9293-e8849d5ce96e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:03.170808 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6fa5674a-5358-48f2-9293-e8849d5ce96e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:03.171547 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6fa5674a-5358-48f2-9293-e8849d5ce96e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:03.171999 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6fa5674a-5358-48f2-9293-e8849d5ce96e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:03.172417 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6fa5674a-5358-48f2-9293-e8849d5ce96e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:03.238149 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-6fa5674a-5358-48f2-9293-e8849d5ce96e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:03.246414 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-6fa5674a-5358-48f2-9293-e8849d5ce96e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1201 microversion: 2.1 time: 0.087176 Oct 26 11:21:03.247052 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 185/385] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:03 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1201 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:03.425340 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-614bcf9a-0d7f-4fe3-8281-acc8aa2e62b7 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 204 len: 0 microversion: 2.1 time: 0.300153 Oct 26 11:21:03.426002 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 201/386] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Oct 26 11:21:03 2022] DELETE /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 11:21:03.435167 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-41ac9311-3c80-4caf-b621-d395969e0881 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:03.435787 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-41ac9311-3c80-4caf-b621-d395969e0881 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:03.437717 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:21:03.442569 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-41ac9311-3c80-4caf-b621-d395969e0881 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:03.443284 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-41ac9311-3c80-4caf-b621-d395969e0881 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:03.443781 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-41ac9311-3c80-4caf-b621-d395969e0881 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:03.444477 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-41ac9311-3c80-4caf-b621-d395969e0881 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:03.444934 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-41ac9311-3c80-4caf-b621-d395969e0881 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:03.445359 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-41ac9311-3c80-4caf-b621-d395969e0881 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:03.464153 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=100 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:21:03.646925 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-41ac9311-3c80-4caf-b621-d395969e0881 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:03.655029 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-41ac9311-3c80-4caf-b621-d395969e0881 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 200 len: 1503 microversion: 2.1 time: 0.224482 Oct 26 11:21:03.655693 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 186/387] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:03 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 1503 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:03.954366 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-9aec48bb-8152-47a5-80f8-93cfedc7ddb6 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:03.955220 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-9aec48bb-8152-47a5-80f8-93cfedc7ddb6 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:03.961393 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9aec48bb-8152-47a5-80f8-93cfedc7ddb6 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:03.961885 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9aec48bb-8152-47a5-80f8-93cfedc7ddb6 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:03.965905 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9aec48bb-8152-47a5-80f8-93cfedc7ddb6 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:03.965905 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9aec48bb-8152-47a5-80f8-93cfedc7ddb6 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:03.965905 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9aec48bb-8152-47a5-80f8-93cfedc7ddb6 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:03.965905 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9aec48bb-8152-47a5-80f8-93cfedc7ddb6 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:04.171985 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-9aec48bb-8152-47a5-80f8-93cfedc7ddb6 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:04.179754 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-9aec48bb-8152-47a5-80f8-93cfedc7ddb6 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1371 microversion: 2.1 time: 0.229692 Oct 26 11:21:04.180332 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 202/388] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:03 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:04.269642 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-f68a2708-53b7-43ee-a18e-580168df16a0 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:04.270465 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-f68a2708-53b7-43ee-a18e-580168df16a0 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:04.278989 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f68a2708-53b7-43ee-a18e-580168df16a0 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:04.279536 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f68a2708-53b7-43ee-a18e-580168df16a0 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:04.279993 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f68a2708-53b7-43ee-a18e-580168df16a0 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:04.280734 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f68a2708-53b7-43ee-a18e-580168df16a0 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:04.281222 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f68a2708-53b7-43ee-a18e-580168df16a0 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:04.281653 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f68a2708-53b7-43ee-a18e-580168df16a0 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:04.345026 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-f68a2708-53b7-43ee-a18e-580168df16a0 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:04.353148 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-f68a2708-53b7-43ee-a18e-580168df16a0 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1201 microversion: 2.1 time: 0.087564 Oct 26 11:21:04.353769 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 187/389] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:04 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1201 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:04.683605 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-cddb3d07-624d-466a-9625-db05a99f4d05 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:04.684141 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-cddb3d07-624d-466a-9625-db05a99f4d05 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:04.690067 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-cddb3d07-624d-466a-9625-db05a99f4d05 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:04.690607 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-cddb3d07-624d-466a-9625-db05a99f4d05 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:04.691510 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-cddb3d07-624d-466a-9625-db05a99f4d05 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:04.692199 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-cddb3d07-624d-466a-9625-db05a99f4d05 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:04.692655 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-cddb3d07-624d-466a-9625-db05a99f4d05 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:04.693078 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-cddb3d07-624d-466a-9625-db05a99f4d05 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:05.112847 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-cddb3d07-624d-466a-9625-db05a99f4d05 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:05.121002 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-cddb3d07-624d-466a-9625-db05a99f4d05 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 200 len: 1503 microversion: 2.1 time: 0.442046 Oct 26 11:21:05.121578 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 203/390] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:04 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 1503 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:05.202900 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-38183e03-cd79-40d2-a468-a3da75435d81 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:05.203544 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-38183e03-cd79-40d2-a468-a3da75435d81 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:05.209349 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-38183e03-cd79-40d2-a468-a3da75435d81 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:05.209834 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-38183e03-cd79-40d2-a468-a3da75435d81 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:05.210272 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-38183e03-cd79-40d2-a468-a3da75435d81 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:05.210994 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-38183e03-cd79-40d2-a468-a3da75435d81 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:05.211452 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-38183e03-cd79-40d2-a468-a3da75435d81 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:05.211880 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-38183e03-cd79-40d2-a468-a3da75435d81 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:05.346240 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-7f3c5be8-372b-46d4-a156-873b22860e71 req-5b43cc42-bb46-41b1-896f-43dc0be1de7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4b20a22-cb3b-4fb4-8b69-3b626cd6d991", "tag": "de570ff5-446d-40b7-add4-d927b658a166"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:21:05.357072 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-7f3c5be8-372b-46d4-a156-873b22860e71 req-5b43cc42-bb46-41b1-896f-43dc0be1de7f service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:05.357551 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-7f3c5be8-372b-46d4-a156-873b22860e71 req-5b43cc42-bb46-41b1-896f-43dc0be1de7f service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:05.358091 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-7f3c5be8-372b-46d4-a156-873b22860e71 req-5b43cc42-bb46-41b1-896f-43dc0be1de7f service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:05.372991 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-7f3c5be8-372b-46d4-a156-873b22860e71 req-5b43cc42-bb46-41b1-896f-43dc0be1de7f service nova] Creating event network-changed:de570ff5-446d-40b7-add4-d927b658a166 for instance e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 on hv-cinder-81558 Oct 26 11:21:05.379190 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-7f3c5be8-372b-46d4-a156-873b22860e71 req-5b43cc42-bb46-41b1-896f-43dc0be1de7f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036134 Oct 26 11:21:05.379834 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 204/391] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:21:05.381817 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-38183e03-cd79-40d2-a468-a3da75435d81 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:05.386138 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-a6ea9977-4d89-46a0-839e-1e2c5b784549 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:05.386880 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-a6ea9977-4d89-46a0-839e-1e2c5b784549 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:05.390266 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-38183e03-cd79-40d2-a468-a3da75435d81 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1371 microversion: 2.1 time: 0.191159 Oct 26 11:21:05.390959 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 188/392] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:05 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:05.399036 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a6ea9977-4d89-46a0-839e-1e2c5b784549 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:05.399036 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a6ea9977-4d89-46a0-839e-1e2c5b784549 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:05.399036 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a6ea9977-4d89-46a0-839e-1e2c5b784549 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:05.399036 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a6ea9977-4d89-46a0-839e-1e2c5b784549 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:05.399363 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a6ea9977-4d89-46a0-839e-1e2c5b784549 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:05.399363 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a6ea9977-4d89-46a0-839e-1e2c5b784549 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:05.459598 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-a6ea9977-4d89-46a0-839e-1e2c5b784549 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:05.468090 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-a6ea9977-4d89-46a0-839e-1e2c5b784549 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1211 microversion: 2.1 time: 0.086912 Oct 26 11:21:05.468659 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 205/393] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:05 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1211 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:06.144369 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-96eb83ad-6cdb-4b3a-8f62-d2574cdbe5d3 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:06.145057 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-96eb83ad-6cdb-4b3a-8f62-d2574cdbe5d3 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:06.151272 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-96eb83ad-6cdb-4b3a-8f62-d2574cdbe5d3 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:06.151756 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-96eb83ad-6cdb-4b3a-8f62-d2574cdbe5d3 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:06.152188 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-96eb83ad-6cdb-4b3a-8f62-d2574cdbe5d3 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:06.152879 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-96eb83ad-6cdb-4b3a-8f62-d2574cdbe5d3 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:06.153329 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-96eb83ad-6cdb-4b3a-8f62-d2574cdbe5d3 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:06.153743 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-96eb83ad-6cdb-4b3a-8f62-d2574cdbe5d3 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:06.375631 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-96eb83ad-6cdb-4b3a-8f62-d2574cdbe5d3 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:06.385942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-96eb83ad-6cdb-4b3a-8f62-d2574cdbe5d3 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 200 len: 1503 microversion: 2.1 time: 0.244675 Oct 26 11:21:06.386588 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 189/394] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:06 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 1503 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:06.413905 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-c838457d-a422-42a9-b183-472d98a3419d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:06.414537 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-c838457d-a422-42a9-b183-472d98a3419d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:06.421343 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c838457d-a422-42a9-b183-472d98a3419d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:06.421833 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c838457d-a422-42a9-b183-472d98a3419d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:06.422261 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c838457d-a422-42a9-b183-472d98a3419d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:06.422993 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c838457d-a422-42a9-b183-472d98a3419d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:06.423444 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c838457d-a422-42a9-b183-472d98a3419d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:06.423861 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c838457d-a422-42a9-b183-472d98a3419d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:06.491085 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-871716d4-4c60-4ec5-8ba0-d25ce9971b12 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:06.492265 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-871716d4-4c60-4ec5-8ba0-d25ce9971b12 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:06.500105 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-871716d4-4c60-4ec5-8ba0-d25ce9971b12 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:06.500869 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-871716d4-4c60-4ec5-8ba0-d25ce9971b12 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:06.501507 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-871716d4-4c60-4ec5-8ba0-d25ce9971b12 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:06.502548 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-871716d4-4c60-4ec5-8ba0-d25ce9971b12 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:06.503484 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-871716d4-4c60-4ec5-8ba0-d25ce9971b12 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:06.504129 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-871716d4-4c60-4ec5-8ba0-d25ce9971b12 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:06.573953 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-c838457d-a422-42a9-b183-472d98a3419d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:06.582394 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-c838457d-a422-42a9-b183-472d98a3419d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1565 microversion: 2.1 time: 0.172594 Oct 26 11:21:06.587323 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 206/395] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:06 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:06.610311 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-374f98bf-ed04-4912-bdbe-f7a1444bfab1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:06.611083 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-374f98bf-ed04-4912-bdbe-f7a1444bfab1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:06.615343 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-871716d4-4c60-4ec5-8ba0-d25ce9971b12 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:06.618138 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-374f98bf-ed04-4912-bdbe-f7a1444bfab1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:06.618807 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-374f98bf-ed04-4912-bdbe-f7a1444bfab1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:06.620168 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-374f98bf-ed04-4912-bdbe-f7a1444bfab1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:06.621026 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-374f98bf-ed04-4912-bdbe-f7a1444bfab1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:06.621624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-374f98bf-ed04-4912-bdbe-f7a1444bfab1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:06.622192 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-374f98bf-ed04-4912-bdbe-f7a1444bfab1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:06.630802 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-871716d4-4c60-4ec5-8ba0-d25ce9971b12 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1211 microversion: 2.1 time: 0.141488 Oct 26 11:21:06.631678 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 190/396] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:06 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1211 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:21:06.709122 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-374f98bf-ed04-4912-bdbe-f7a1444bfab1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102701 Oct 26 11:21:06.709777 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 207/397] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Oct 26 11:21:06 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:21:07.411784 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-677b9b80-1571-4571-ae41-15757b8d1862 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:07.413094 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-677b9b80-1571-4571-ae41-15757b8d1862 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:07.427596 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-677b9b80-1571-4571-ae41-15757b8d1862 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:07.428104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-677b9b80-1571-4571-ae41-15757b8d1862 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:07.428545 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-677b9b80-1571-4571-ae41-15757b8d1862 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:07.429262 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-677b9b80-1571-4571-ae41-15757b8d1862 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:07.429978 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-677b9b80-1571-4571-ae41-15757b8d1862 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:07.430393 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-677b9b80-1571-4571-ae41-15757b8d1862 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:07.655751 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-6d21e614-7fc4-4e4b-a49b-c033582dece2 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:07.656997 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-6d21e614-7fc4-4e4b-a49b-c033582dece2 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:07.663803 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6d21e614-7fc4-4e4b-a49b-c033582dece2 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:07.664499 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6d21e614-7fc4-4e4b-a49b-c033582dece2 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:07.664936 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6d21e614-7fc4-4e4b-a49b-c033582dece2 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:07.665851 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6d21e614-7fc4-4e4b-a49b-c033582dece2 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:07.666309 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6d21e614-7fc4-4e4b-a49b-c033582dece2 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:07.666923 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6d21e614-7fc4-4e4b-a49b-c033582dece2 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:07.987184 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-677b9b80-1571-4571-ae41-15757b8d1862 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:07.999891 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-677b9b80-1571-4571-ae41-15757b8d1862 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 200 len: 1503 microversion: 2.1 time: 0.592240 Oct 26 11:21:08.001362 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 191/398] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:07 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 1503 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:08.007977 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-9a6fca8e-ebb2-4d0c-a627-92e714b43527 req-37a8db53-da10-4a0e-8128-b28cd6971e4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b059e78c-afde-4f1f-9a77-b2d6d5aa4e77", "name": "network-vif-deleted", "tag": "888991fc-f82a-47f3-b3e6-2895c3ae654e"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:21:08.024512 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-9a6fca8e-ebb2-4d0c-a627-92e714b43527 req-37a8db53-da10-4a0e-8128-b28cd6971e4e service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:08.028651 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-9a6fca8e-ebb2-4d0c-a627-92e714b43527 req-37a8db53-da10-4a0e-8128-b28cd6971e4e service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:08.029200 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-9a6fca8e-ebb2-4d0c-a627-92e714b43527 req-37a8db53-da10-4a0e-8128-b28cd6971e4e service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:08.044021 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-9a6fca8e-ebb2-4d0c-a627-92e714b43527 req-37a8db53-da10-4a0e-8128-b28cd6971e4e service nova] Creating event network-vif-deleted:888991fc-f82a-47f3-b3e6-2895c3ae654e for instance b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 on hv-cinder-81558 Oct 26 11:21:08.052766 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-9a6fca8e-ebb2-4d0c-a627-92e714b43527 req-37a8db53-da10-4a0e-8128-b28cd6971e4e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049290 Oct 26 11:21:08.058874 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 192/399] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:21:08.401136 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-6d21e614-7fc4-4e4b-a49b-c033582dece2 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:08.414581 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-6d21e614-7fc4-4e4b-a49b-c033582dece2 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1279 microversion: 2.1 time: 0.764225 Oct 26 11:21:08.416852 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 208/400] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:07 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1279 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:08.925517 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-a2e9f484-1e9e-4181-afc0-075d3c083e56 req-021ff399-0df7-41f9-8079-690a917d2814 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "975e97a1-fe2c-4f81-88b5-274a052109c6", "tag": "aa03144d-b19b-4e5d-8027-1ca2393de35d"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:21:08.935986 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-a2e9f484-1e9e-4181-afc0-075d3c083e56 req-021ff399-0df7-41f9-8079-690a917d2814 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:08.936466 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-a2e9f484-1e9e-4181-afc0-075d3c083e56 req-021ff399-0df7-41f9-8079-690a917d2814 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:08.938193 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-a2e9f484-1e9e-4181-afc0-075d3c083e56 req-021ff399-0df7-41f9-8079-690a917d2814 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:08.949875 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-a2e9f484-1e9e-4181-afc0-075d3c083e56 req-021ff399-0df7-41f9-8079-690a917d2814 service nova] Creating event network-changed:aa03144d-b19b-4e5d-8027-1ca2393de35d for instance 975e97a1-fe2c-4f81-88b5-274a052109c6 on hv-cinder-81558 Oct 26 11:21:08.954742 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-a2e9f484-1e9e-4181-afc0-075d3c083e56 req-021ff399-0df7-41f9-8079-690a917d2814 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033793 Oct 26 11:21:08.955495 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 193/401] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:21:09.025571 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-be39f3ec-fa4b-45f0-bbdc-d25985851329 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:09.027405 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-be39f3ec-fa4b-45f0-bbdc-d25985851329 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:09.033373 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-be39f3ec-fa4b-45f0-bbdc-d25985851329 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:09.033857 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-be39f3ec-fa4b-45f0-bbdc-d25985851329 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:09.034289 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-be39f3ec-fa4b-45f0-bbdc-d25985851329 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:09.035015 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-be39f3ec-fa4b-45f0-bbdc-d25985851329 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:09.035467 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-be39f3ec-fa4b-45f0-bbdc-d25985851329 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:09.035883 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-be39f3ec-fa4b-45f0-bbdc-d25985851329 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:09.068177 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-be39f3ec-fa4b-45f0-bbdc-d25985851329 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:09.068663 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-be39f3ec-fa4b-45f0-bbdc-d25985851329 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:09.069088 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-be39f3ec-fa4b-45f0-bbdc-d25985851329 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:09.069520 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.objects.instance [None req-be39f3ec-fa4b-45f0-bbdc-d25985851329 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lazy-loading 'fault' on Instance uuid b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 {{(pid=119306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:21:09.116012 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-be39f3ec-fa4b-45f0-bbdc-d25985851329 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79972df53cf4245be9c45a9b579cff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576eb9289f147f2ab9ba6f1c00b3ffd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:09.122624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-be39f3ec-fa4b-45f0-bbdc-d25985851329 tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 200 len: 1303 microversion: 2.1 time: 0.101000 Oct 26 11:21:09.123348 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 209/402] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:09 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:09.443372 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-6f56e4fc-65ba-4cfb-abff-da6a2e89dbcb tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:09.445625 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-6f56e4fc-65ba-4cfb-abff-da6a2e89dbcb tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:09.459345 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6f56e4fc-65ba-4cfb-abff-da6a2e89dbcb tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:09.459937 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6f56e4fc-65ba-4cfb-abff-da6a2e89dbcb tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:09.460276 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6f56e4fc-65ba-4cfb-abff-da6a2e89dbcb tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:09.460979 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6f56e4fc-65ba-4cfb-abff-da6a2e89dbcb tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:09.461441 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6f56e4fc-65ba-4cfb-abff-da6a2e89dbcb tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:09.461859 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6f56e4fc-65ba-4cfb-abff-da6a2e89dbcb tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:09.696680 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-6f56e4fc-65ba-4cfb-abff-da6a2e89dbcb tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:09.714685 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-6f56e4fc-65ba-4cfb-abff-da6a2e89dbcb tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1267 microversion: 2.1 time: 0.270612 Oct 26 11:21:09.715740 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 194/403] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:09 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1267 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:10.068761 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-b4ea0f10-78ad-4c47-844f-14ae4ee0baab req-2db59760-22b1-4ca2-9067-6ae04c365fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f64d1d1-56f2-4ec0-b93a-faceb3411d40", "tag": "f2bbf28a-4a02-46b3-af42-40afd907a949"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:21:10.081200 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-b4ea0f10-78ad-4c47-844f-14ae4ee0baab req-2db59760-22b1-4ca2-9067-6ae04c365fe7 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:10.084850 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-b4ea0f10-78ad-4c47-844f-14ae4ee0baab req-2db59760-22b1-4ca2-9067-6ae04c365fe7 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:10.084850 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-b4ea0f10-78ad-4c47-844f-14ae4ee0baab req-2db59760-22b1-4ca2-9067-6ae04c365fe7 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:10.094103 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-b4ea0f10-78ad-4c47-844f-14ae4ee0baab req-2db59760-22b1-4ca2-9067-6ae04c365fe7 service nova] Creating event network-changed:f2bbf28a-4a02-46b3-af42-40afd907a949 for instance 1f64d1d1-56f2-4ec0-b93a-faceb3411d40 on hv-cinder-81558 Oct 26 11:21:10.099310 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-b4ea0f10-78ad-4c47-844f-14ae4ee0baab req-2db59760-22b1-4ca2-9067-6ae04c365fe7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034672 Oct 26 11:21:10.099914 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 210/404] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:21:10.145403 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-21158baa-002b-4bdc-9329-82a5a8f5f24e tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:10.146164 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-21158baa-002b-4bdc-9329-82a5a8f5f24e tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] [instance: b059e78c-afde-4f1f-9a77-b2d6d5aa4e77] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:10.152416 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-21158baa-002b-4bdc-9329-82a5a8f5f24e tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:10.152900 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-21158baa-002b-4bdc-9329-82a5a8f5f24e tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:10.153348 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-21158baa-002b-4bdc-9329-82a5a8f5f24e tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:10.154048 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-21158baa-002b-4bdc-9329-82a5a8f5f24e tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:10.154503 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-21158baa-002b-4bdc-9329-82a5a8f5f24e tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:10.155024 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-21158baa-002b-4bdc-9329-82a5a8f5f24e tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:10.169152 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.wsgi [None req-21158baa-002b-4bdc-9329-82a5a8f5f24e tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] HTTP exception thrown: Instance b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 could not be found. Oct 26 11:21:10.170807 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-21158baa-002b-4bdc-9329-82a5a8f5f24e tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Request method failure captured: Oct 26 11:21:10.170807 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: request: GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 HTTP/1.1 Oct 26 11:21:10.170807 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept: application/json Oct 26 11:21:10.170807 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept-Encoding: identity Oct 26 11:21:10.170807 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Connection: close Oct 26 11:21:10.170807 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Length: 0 Oct 26 11:21:10.170807 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Type: application/json Oct 26 11:21:10.170807 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Host: 10.222.0.42 Oct 26 11:21:10.170807 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Openstack-System-Scope: None Oct 26 11:21:10.170807 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: User-Agent: python-urllib3/1.26.12 Oct 26 11:21:10.170807 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Auth-Token: gAAAAABjWRfRVGi25fndz9tZRdavm38qjTT7NJirS-b77jfm689_qbcAHS6SvYplIT3sko6For2ef-c1Dkzk5tUcXtd_ZjUs8XiXR2Y_0BW2KQGe8Q_nJiZ_K91eNzbcMjQBOsY_Oc-bpSkfPXAnxs82IpzXJu7iz6X4gUFqqbirf42QKfiFrBk Oct 26 11:21:10.170807 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Id: None Oct 26 11:21:10.170807 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Name: None Oct 26 11:21:10.170807 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Identity-Status: Confirmed Oct 26 11:21:10.170807 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Is-Admin-Project: True Oct 26 11:21:10.170807 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Id: default Oct 26 11:21:10.170807 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Name: Default Oct 26 11:21:10.170807 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Id: 8576eb9289f147f2ab9ba6f1c00b3ffd Oct 26 11:21:10.170807 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Name: tempest-VolumesActionsTest-2075731229 Oct 26 11:21:10.170807 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Role: member,reader Oct 26 11:21:10.170807 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Roles: member,reader Oct 26 11:21:10.172124 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8576eb9289f147f2ab9ba6f1c00b3ffd", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8576eb9289f147f2ab9ba6f1c00b3ffd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8576eb9289f147f2ab9ba6f1c00b3ffd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8576eb9289f147f2ab9ba6f1c00b3ffd"}]}] Oct 26 11:21:10.172124 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant: tempest-VolumesActionsTest-2075731229 Oct 26 11:21:10.172124 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Id: 8576eb9289f147f2ab9ba6f1c00b3ffd Oct 26 11:21:10.172124 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Name: tempest-VolumesActionsTest-2075731229 Oct 26 11:21:10.172124 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User: tempest-VolumesActionsTest-2075731229-project Oct 26 11:21:10.172124 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Id: default Oct 26 11:21:10.172124 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Name: Default Oct 26 11:21:10.172124 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Id: a79972df53cf4245be9c45a9b579cff9 Oct 26 11:21:10.172124 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Name: tempest-VolumesActionsTest-2075731229-project Oct 26 11:21:10.172124 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: method: > Oct 26 11:21:10.172124 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: exception: Instance b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 could not be found. Oct 26 11:21:10.172124 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: action_args: {'id': 'b059e78c-afde-4f1f-9a77-b2d6d5aa4e77'} Oct 26 11:21:10.172931 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:21:10.172931 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:21:10.172931 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:21:10.172931 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:21:10.172931 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:21:10.172931 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:21:10.172931 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:21:10.172931 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:21:10.172931 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:21:10.172931 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:21:10.172931 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 could not be found. Oct 26 11:21:10.172931 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:21:10.172931 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:21:10.172931 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:21:10.172931 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:21:10.172931 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:21:10.172931 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:21:10.172931 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:21:10.172931 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:21:10.172931 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:21:10.174121 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:21:10.174121 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 11:21:10.174121 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 11:21:10.174121 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:21:10.174121 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:21:10.174121 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:21:10.174121 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:21:10.174121 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 could not be found. Oct 26 11:21:10.174121 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:21:10.174121 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:21:10.174121 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:21:10.174121 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:21:10.174121 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:21:10.174121 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:21:10.174121 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:21:10.174121 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:21:10.174121 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 could not be found. Oct 26 11:21:10.174121 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:21:10.176709 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-21158baa-002b-4bdc-9329-82a5a8f5f24e tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] Returning 404 to user: Instance b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 could not be found. {{(pid=119305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:21:10.176709 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-21158baa-002b-4bdc-9329-82a5a8f5f24e tempest-VolumesActionsTest-2075731229 tempest-VolumesActionsTest-2075731229-project] 10.222.0.42 "GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77" status: 404 len: 111 microversion: 2.1 time: 0.030739 Oct 26 11:21:10.176709 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 195/405] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:10 2022] GET /compute/v2.1/servers/b059e78c-afde-4f1f-9a77-b2d6d5aa4e77 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:21:10.739613 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-5303ca1b-ce64-49c5-82b5-e921adb1c3d2 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:10.740348 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-5303ca1b-ce64-49c5-82b5-e921adb1c3d2 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:10.746753 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5303ca1b-ce64-49c5-82b5-e921adb1c3d2 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:10.747282 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5303ca1b-ce64-49c5-82b5-e921adb1c3d2 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:10.747824 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5303ca1b-ce64-49c5-82b5-e921adb1c3d2 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:10.748586 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5303ca1b-ce64-49c5-82b5-e921adb1c3d2 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:10.748956 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5303ca1b-ce64-49c5-82b5-e921adb1c3d2 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:10.749372 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5303ca1b-ce64-49c5-82b5-e921adb1c3d2 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:10.908111 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-5303ca1b-ce64-49c5-82b5-e921adb1c3d2 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:10.918364 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-5303ca1b-ce64-49c5-82b5-e921adb1c3d2 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1267 microversion: 2.1 time: 0.182758 Oct 26 11:21:10.919429 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 211/406] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:10 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:11.946401 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-1b51f75c-2007-477e-a690-8f09079149c5 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:11.946987 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-1b51f75c-2007-477e-a690-8f09079149c5 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:11.953546 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1b51f75c-2007-477e-a690-8f09079149c5 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:11.954024 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1b51f75c-2007-477e-a690-8f09079149c5 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:11.954456 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1b51f75c-2007-477e-a690-8f09079149c5 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:11.955161 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1b51f75c-2007-477e-a690-8f09079149c5 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:11.955621 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1b51f75c-2007-477e-a690-8f09079149c5 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:11.956113 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1b51f75c-2007-477e-a690-8f09079149c5 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:12.088554 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-1b51f75c-2007-477e-a690-8f09079149c5 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:12.096829 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-1b51f75c-2007-477e-a690-8f09079149c5 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1267 microversion: 2.1 time: 0.154577 Oct 26 11:21:12.097393 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 196/407] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:11 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:12.985542 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-f7ebaa32-73f2-4044-a882-a89bc6601d98 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1116658438", "imageRef": "ed8b5733-339c-4fa7-9767-abef514cb9f2", "flavorRef": "452"}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:21:13.037292 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.network.neutron [None req-f7ebaa32-73f2-4044-a882-a89bc6601d98 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] validate_networks() for None {{(pid=119306) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 11:21:13.126399 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-2610ed5b-7597-4dde-9f61-a5a6e032d518 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:13.127037 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-2610ed5b-7597-4dde-9f61-a5a6e032d518 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:13.133556 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2610ed5b-7597-4dde-9f61-a5a6e032d518 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:13.134054 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2610ed5b-7597-4dde-9f61-a5a6e032d518 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:13.134491 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2610ed5b-7597-4dde-9f61-a5a6e032d518 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:13.135206 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2610ed5b-7597-4dde-9f61-a5a6e032d518 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:13.135657 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2610ed5b-7597-4dde-9f61-a5a6e032d518 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:13.136757 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2610ed5b-7597-4dde-9f61-a5a6e032d518 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:13.266660 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-2610ed5b-7597-4dde-9f61-a5a6e032d518 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:13.274313 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-2610ed5b-7597-4dde-9f61-a5a6e032d518 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1267 microversion: 2.1 time: 0.152163 Oct 26 11:21:13.274896 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 197/408] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:13 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:21:13.311042 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-f7ebaa32-73f2-4044-a882-a89bc6601d98 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Flavor limits 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 11:21:13.311459 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-f7ebaa32-73f2-4044-a882-a89bc6601d98 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Image limits 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 11:21:13.311943 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-f7ebaa32-73f2-4044-a882-a89bc6601d98 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Flavor pref 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 11:21:13.312345 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-f7ebaa32-73f2-4044-a882-a89bc6601d98 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Image pref 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 11:21:13.312770 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-f7ebaa32-73f2-4044-a882-a89bc6601d98 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 11:21:13.321647 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f7ebaa32-73f2-4044-a882-a89bc6601d98 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:13.322114 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f7ebaa32-73f2-4044-a882-a89bc6601d98 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:13.322540 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f7ebaa32-73f2-4044-a882-a89bc6601d98 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:13.323323 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f7ebaa32-73f2-4044-a882-a89bc6601d98 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:13.323776 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f7ebaa32-73f2-4044-a882-a89bc6601d98 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:13.324192 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f7ebaa32-73f2-4044-a882-a89bc6601d98 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:13.340236 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-f7ebaa32-73f2-4044-a882-a89bc6601d98 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Getting quotas for project 3c55d5d8b72b4cf3b348995f49e96c5f. Resources: {'cores', 'instances', 'ram'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:21:13.344105 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-f7ebaa32-73f2-4044-a882-a89bc6601d98 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Getting quotas for user 3ddef6f6009e4c638b3c0f0cc2d4ccd9 and project 3c55d5d8b72b4cf3b348995f49e96c5f. Resources: {'cores', 'instances', 'ram'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:21:13.355501 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-f7ebaa32-73f2-4044-a882-a89bc6601d98 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Going to run 1 instances... {{(pid=119306) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 11:21:13.357824 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-f7ebaa32-73f2-4044-a882-a89bc6601d98 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] [instance: f56cb0b4-cb10-4cd6-967b-1cd875517f26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed8b5733-339c-4fa7-9767-abef514cb9f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119306) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 11:21:13.513962 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-f7ebaa32-73f2-4044-a882-a89bc6601d98 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532245 Oct 26 11:21:13.517141 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 212/409] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Oct 26 11:21:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 11:21:13.525705 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-906561c8-4ece-4980-a2e1-cc679a05135d tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:13.526314 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-906561c8-4ece-4980-a2e1-cc679a05135d tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] [instance: f56cb0b4-cb10-4cd6-967b-1cd875517f26] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:13.579133 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-906561c8-4ece-4980-a2e1-cc679a05135d tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddef6f6009e4c638b3c0f0cc2d4ccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55d5d8b72b4cf3b348995f49e96c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:13.585952 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-906561c8-4ece-4980-a2e1-cc679a05135d tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] 10.222.0.42 "GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26" status: 200 len: 1215 microversion: 2.1 time: 0.064101 Oct 26 11:21:13.586558 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 198/410] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:13 2022] GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26 => generated 1215 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:14.297465 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-a52beec1-e0a8-4579-ac1b-7e2d785a4e28 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:14.298080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-a52beec1-e0a8-4579-ac1b-7e2d785a4e28 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:14.304545 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a52beec1-e0a8-4579-ac1b-7e2d785a4e28 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:14.305031 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a52beec1-e0a8-4579-ac1b-7e2d785a4e28 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:14.305465 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a52beec1-e0a8-4579-ac1b-7e2d785a4e28 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:14.306147 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a52beec1-e0a8-4579-ac1b-7e2d785a4e28 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:14.306597 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a52beec1-e0a8-4579-ac1b-7e2d785a4e28 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:14.307053 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a52beec1-e0a8-4579-ac1b-7e2d785a4e28 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:14.435776 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-a52beec1-e0a8-4579-ac1b-7e2d785a4e28 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:14.443640 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-a52beec1-e0a8-4579-ac1b-7e2d785a4e28 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1267 microversion: 2.1 time: 0.150221 Oct 26 11:21:14.444209 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 213/411] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:14 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:14.609133 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-91d83ff9-fc11-4bab-af7f-08f4742fc534 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:14.609740 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-91d83ff9-fc11-4bab-af7f-08f4742fc534 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] [instance: f56cb0b4-cb10-4cd6-967b-1cd875517f26] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:14.616129 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-91d83ff9-fc11-4bab-af7f-08f4742fc534 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:14.616610 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-91d83ff9-fc11-4bab-af7f-08f4742fc534 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:14.617039 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-91d83ff9-fc11-4bab-af7f-08f4742fc534 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:14.617739 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-91d83ff9-fc11-4bab-af7f-08f4742fc534 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:14.618188 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-91d83ff9-fc11-4bab-af7f-08f4742fc534 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:14.618604 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-91d83ff9-fc11-4bab-af7f-08f4742fc534 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:14.682643 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-91d83ff9-fc11-4bab-af7f-08f4742fc534 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddef6f6009e4c638b3c0f0cc2d4ccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55d5d8b72b4cf3b348995f49e96c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:14.690915 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-91d83ff9-fc11-4bab-af7f-08f4742fc534 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] 10.222.0.42 "GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26" status: 200 len: 1219 microversion: 2.1 time: 0.085667 Oct 26 11:21:14.691476 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 199/412] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:14 2022] GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:15.466477 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-9abe8ded-3619-44c5-9092-4c9968cfda64 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:15.467118 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-9abe8ded-3619-44c5-9092-4c9968cfda64 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:15.473056 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9abe8ded-3619-44c5-9092-4c9968cfda64 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:15.473541 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9abe8ded-3619-44c5-9092-4c9968cfda64 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:15.473976 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9abe8ded-3619-44c5-9092-4c9968cfda64 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:15.474660 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9abe8ded-3619-44c5-9092-4c9968cfda64 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:15.475152 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9abe8ded-3619-44c5-9092-4c9968cfda64 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:15.475578 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9abe8ded-3619-44c5-9092-4c9968cfda64 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:15.608235 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-9abe8ded-3619-44c5-9092-4c9968cfda64 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:15.616128 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-9abe8ded-3619-44c5-9092-4c9968cfda64 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1267 microversion: 2.1 time: 0.154229 Oct 26 11:21:15.616691 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 214/413] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:15 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:15.714023 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a737e15c-9876-4879-b14d-d09290c161a8 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:15.715281 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-a737e15c-9876-4879-b14d-d09290c161a8 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] [instance: f56cb0b4-cb10-4cd6-967b-1cd875517f26] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:15.721611 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a737e15c-9876-4879-b14d-d09290c161a8 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:15.722094 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a737e15c-9876-4879-b14d-d09290c161a8 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:15.722619 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a737e15c-9876-4879-b14d-d09290c161a8 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:15.723407 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a737e15c-9876-4879-b14d-d09290c161a8 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:15.723859 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a737e15c-9876-4879-b14d-d09290c161a8 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:15.724277 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a737e15c-9876-4879-b14d-d09290c161a8 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:15.785177 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-a737e15c-9876-4879-b14d-d09290c161a8 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddef6f6009e4c638b3c0f0cc2d4ccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55d5d8b72b4cf3b348995f49e96c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:15.792897 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-a737e15c-9876-4879-b14d-d09290c161a8 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] 10.222.0.42 "GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26" status: 200 len: 1219 microversion: 2.1 time: 0.082736 Oct 26 11:21:15.793470 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 200/414] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:15 2022] GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:16.639026 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-8fb59d38-17cc-476e-80e8-49ee9b14355e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:16.639675 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-8fb59d38-17cc-476e-80e8-49ee9b14355e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:16.645569 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8fb59d38-17cc-476e-80e8-49ee9b14355e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:16.646049 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8fb59d38-17cc-476e-80e8-49ee9b14355e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:16.646487 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8fb59d38-17cc-476e-80e8-49ee9b14355e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:16.647203 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8fb59d38-17cc-476e-80e8-49ee9b14355e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:16.647686 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8fb59d38-17cc-476e-80e8-49ee9b14355e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:16.648107 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8fb59d38-17cc-476e-80e8-49ee9b14355e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:16.778175 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-8fb59d38-17cc-476e-80e8-49ee9b14355e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:16.786235 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-8fb59d38-17cc-476e-80e8-49ee9b14355e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1267 microversion: 2.1 time: 0.151113 Oct 26 11:21:16.786734 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 215/415] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:16 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:16.815463 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-41b3d268-2ebb-411b-92e1-5023889e6127 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:16.816067 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-41b3d268-2ebb-411b-92e1-5023889e6127 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] [instance: f56cb0b4-cb10-4cd6-967b-1cd875517f26] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:16.822662 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-41b3d268-2ebb-411b-92e1-5023889e6127 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:16.823181 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-41b3d268-2ebb-411b-92e1-5023889e6127 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:16.823612 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-41b3d268-2ebb-411b-92e1-5023889e6127 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:16.824294 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-41b3d268-2ebb-411b-92e1-5023889e6127 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:16.824741 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-41b3d268-2ebb-411b-92e1-5023889e6127 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:16.825160 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-41b3d268-2ebb-411b-92e1-5023889e6127 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:16.883631 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-41b3d268-2ebb-411b-92e1-5023889e6127 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddef6f6009e4c638b3c0f0cc2d4ccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55d5d8b72b4cf3b348995f49e96c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:16.892230 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-41b3d268-2ebb-411b-92e1-5023889e6127 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] 10.222.0.42 "GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26" status: 200 len: 1211 microversion: 2.1 time: 0.080631 Oct 26 11:21:16.892788 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 201/416] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:16 2022] GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26 => generated 1211 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:17.810085 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-7050022b-eb66-4c71-9d63-a45a47025c08 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:17.810845 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-7050022b-eb66-4c71-9d63-a45a47025c08 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:17.816874 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7050022b-eb66-4c71-9d63-a45a47025c08 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:17.817438 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7050022b-eb66-4c71-9d63-a45a47025c08 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:17.818197 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7050022b-eb66-4c71-9d63-a45a47025c08 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:17.818949 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7050022b-eb66-4c71-9d63-a45a47025c08 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:17.819406 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7050022b-eb66-4c71-9d63-a45a47025c08 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:17.819833 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7050022b-eb66-4c71-9d63-a45a47025c08 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:17.915464 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-f4a830a3-994e-4835-8400-6fd1d5f34cf3 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:17.916063 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-f4a830a3-994e-4835-8400-6fd1d5f34cf3 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] [instance: f56cb0b4-cb10-4cd6-967b-1cd875517f26] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:17.923174 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f4a830a3-994e-4835-8400-6fd1d5f34cf3 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:17.923862 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f4a830a3-994e-4835-8400-6fd1d5f34cf3 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:17.924446 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f4a830a3-994e-4835-8400-6fd1d5f34cf3 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:17.925298 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f4a830a3-994e-4835-8400-6fd1d5f34cf3 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:17.925749 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f4a830a3-994e-4835-8400-6fd1d5f34cf3 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:17.926163 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f4a830a3-994e-4835-8400-6fd1d5f34cf3 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:17.959050 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-7050022b-eb66-4c71-9d63-a45a47025c08 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:17.979376 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-7050022b-eb66-4c71-9d63-a45a47025c08 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1267 microversion: 2.1 time: 0.161375 Oct 26 11:21:17.979376 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 216/417] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:17 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:17.989708 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-f4a830a3-994e-4835-8400-6fd1d5f34cf3 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddef6f6009e4c638b3c0f0cc2d4ccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55d5d8b72b4cf3b348995f49e96c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:17.998990 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-f4a830a3-994e-4835-8400-6fd1d5f34cf3 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] 10.222.0.42 "GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26" status: 200 len: 1211 microversion: 2.1 time: 0.087231 Oct 26 11:21:18.003868 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 202/418] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:17 2022] GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26 => generated 1211 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:21:18.992634 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-9a76cdd5-7eb1-4444-8871-734685cc9b74 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:18.993486 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-9a76cdd5-7eb1-4444-8871-734685cc9b74 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:19.002734 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9a76cdd5-7eb1-4444-8871-734685cc9b74 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:19.003808 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9a76cdd5-7eb1-4444-8871-734685cc9b74 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:19.005026 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9a76cdd5-7eb1-4444-8871-734685cc9b74 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:19.006466 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9a76cdd5-7eb1-4444-8871-734685cc9b74 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:19.007492 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9a76cdd5-7eb1-4444-8871-734685cc9b74 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:19.008513 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9a76cdd5-7eb1-4444-8871-734685cc9b74 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:19.025260 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-91618668-39bf-455f-9b65-4d876d4c7c7e tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:19.027542 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-91618668-39bf-455f-9b65-4d876d4c7c7e tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] [instance: f56cb0b4-cb10-4cd6-967b-1cd875517f26] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:19.036728 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-91618668-39bf-455f-9b65-4d876d4c7c7e tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:19.037643 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-91618668-39bf-455f-9b65-4d876d4c7c7e tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:19.038316 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-91618668-39bf-455f-9b65-4d876d4c7c7e tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:19.039286 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-91618668-39bf-455f-9b65-4d876d4c7c7e tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:19.039960 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-91618668-39bf-455f-9b65-4d876d4c7c7e tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:19.040602 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-91618668-39bf-455f-9b65-4d876d4c7c7e tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:19.111794 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-91618668-39bf-455f-9b65-4d876d4c7c7e tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddef6f6009e4c638b3c0f0cc2d4ccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55d5d8b72b4cf3b348995f49e96c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:19.122790 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-91618668-39bf-455f-9b65-4d876d4c7c7e tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] 10.222.0.42 "GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26" status: 200 len: 1267 microversion: 2.1 time: 0.101538 Oct 26 11:21:19.138275 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 203/419] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:19 2022] GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26 => generated 1267 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:21:19.174809 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-9a76cdd5-7eb1-4444-8871-734685cc9b74 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:19.178838 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:21:19.184390 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-9a76cdd5-7eb1-4444-8871-734685cc9b74 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1267 microversion: 2.1 time: 0.196368 Oct 26 11:21:19.185199 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 217/420] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:18 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:20.146683 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-6c13c8b5-12f8-45d6-a496-72ea1311b353 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:20.147438 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-6c13c8b5-12f8-45d6-a496-72ea1311b353 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] [instance: f56cb0b4-cb10-4cd6-967b-1cd875517f26] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:20.161271 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6c13c8b5-12f8-45d6-a496-72ea1311b353 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:20.161758 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6c13c8b5-12f8-45d6-a496-72ea1311b353 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:20.162200 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6c13c8b5-12f8-45d6-a496-72ea1311b353 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:20.162978 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6c13c8b5-12f8-45d6-a496-72ea1311b353 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:20.163452 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6c13c8b5-12f8-45d6-a496-72ea1311b353 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:20.165612 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6c13c8b5-12f8-45d6-a496-72ea1311b353 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:20.217682 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e18ce2cb-77a9-4250-9fb2-07d6de72cf6c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:20.219060 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-e18ce2cb-77a9-4250-9fb2-07d6de72cf6c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:20.232128 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e18ce2cb-77a9-4250-9fb2-07d6de72cf6c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:20.233003 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e18ce2cb-77a9-4250-9fb2-07d6de72cf6c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:20.233660 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e18ce2cb-77a9-4250-9fb2-07d6de72cf6c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:20.234610 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e18ce2cb-77a9-4250-9fb2-07d6de72cf6c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:20.235318 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e18ce2cb-77a9-4250-9fb2-07d6de72cf6c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:20.238454 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e18ce2cb-77a9-4250-9fb2-07d6de72cf6c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:20.260225 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-6c13c8b5-12f8-45d6-a496-72ea1311b353 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddef6f6009e4c638b3c0f0cc2d4ccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55d5d8b72b4cf3b348995f49e96c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:20.270788 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-6c13c8b5-12f8-45d6-a496-72ea1311b353 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] 10.222.0.42 "GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26" status: 200 len: 1273 microversion: 2.1 time: 0.128948 Oct 26 11:21:20.280245 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 204/421] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:20 2022] GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26 => generated 1273 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:20.422022 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-e18ce2cb-77a9-4250-9fb2-07d6de72cf6c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:20.430309 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-e18ce2cb-77a9-4250-9fb2-07d6de72cf6c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1267 microversion: 2.1 time: 0.217419 Oct 26 11:21:20.431338 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 218/422] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:20 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1267 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:21:21.297957 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-4cd15e69-be38-4095-b03f-6394c984e1cf tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:21.298587 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-4cd15e69-be38-4095-b03f-6394c984e1cf tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] [instance: f56cb0b4-cb10-4cd6-967b-1cd875517f26] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:21.304782 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4cd15e69-be38-4095-b03f-6394c984e1cf tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:21.305211 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4cd15e69-be38-4095-b03f-6394c984e1cf tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:21.305648 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4cd15e69-be38-4095-b03f-6394c984e1cf tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:21.306348 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4cd15e69-be38-4095-b03f-6394c984e1cf tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:21.306804 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4cd15e69-be38-4095-b03f-6394c984e1cf tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:21.307446 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4cd15e69-be38-4095-b03f-6394c984e1cf tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:21.455840 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-52c8c312-9498-448f-8d7d-92537f19b97d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:21.457253 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-52c8c312-9498-448f-8d7d-92537f19b97d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:21.470946 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-52c8c312-9498-448f-8d7d-92537f19b97d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:21.472098 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-52c8c312-9498-448f-8d7d-92537f19b97d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:21.472910 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-52c8c312-9498-448f-8d7d-92537f19b97d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:21.474892 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-52c8c312-9498-448f-8d7d-92537f19b97d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:21.478553 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-52c8c312-9498-448f-8d7d-92537f19b97d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:21.479361 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-52c8c312-9498-448f-8d7d-92537f19b97d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:21.502937 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-4cd15e69-be38-4095-b03f-6394c984e1cf tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddef6f6009e4c638b3c0f0cc2d4ccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55d5d8b72b4cf3b348995f49e96c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:21.513183 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-4cd15e69-be38-4095-b03f-6394c984e1cf tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] 10.222.0.42 "GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26" status: 200 len: 1315 microversion: 2.1 time: 0.218912 Oct 26 11:21:21.515835 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 205/423] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:21 2022] GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:21.677026 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-52c8c312-9498-448f-8d7d-92537f19b97d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:21.687477 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-52c8c312-9498-448f-8d7d-92537f19b97d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1267 microversion: 2.1 time: 0.236134 Oct 26 11:21:21.688357 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 219/424] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:21 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1267 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:22.218343 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-96b5de3c-c2d5-47b3-ad7a-77eb54a26df1 req-3e982a55-0dfe-4f7e-8660-892b000d6ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f56cb0b4-cb10-4cd6-967b-1cd875517f26", "tag": "a8c71c23-1cf8-44ad-80e0-6e91d3b6207c"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:21:22.233996 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-96b5de3c-c2d5-47b3-ad7a-77eb54a26df1 req-3e982a55-0dfe-4f7e-8660-892b000d6ac1 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:22.237051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-96b5de3c-c2d5-47b3-ad7a-77eb54a26df1 req-3e982a55-0dfe-4f7e-8660-892b000d6ac1 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:22.237051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-96b5de3c-c2d5-47b3-ad7a-77eb54a26df1 req-3e982a55-0dfe-4f7e-8660-892b000d6ac1 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:22.241413 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=100 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:21:22.250658 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-96b5de3c-c2d5-47b3-ad7a-77eb54a26df1 req-3e982a55-0dfe-4f7e-8660-892b000d6ac1 service nova] Creating event network-changed:a8c71c23-1cf8-44ad-80e0-6e91d3b6207c for instance f56cb0b4-cb10-4cd6-967b-1cd875517f26 on hv-cinder-81558 Oct 26 11:21:22.256509 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-96b5de3c-c2d5-47b3-ad7a-77eb54a26df1 req-3e982a55-0dfe-4f7e-8660-892b000d6ac1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043704 Oct 26 11:21:22.257316 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 206/425] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:21:22.537688 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-9c333f40-e475-4871-80d7-0ce2fabae542 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:22.538279 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-9c333f40-e475-4871-80d7-0ce2fabae542 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] [instance: f56cb0b4-cb10-4cd6-967b-1cd875517f26] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:22.545497 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9c333f40-e475-4871-80d7-0ce2fabae542 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:22.546285 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9c333f40-e475-4871-80d7-0ce2fabae542 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:22.546785 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9c333f40-e475-4871-80d7-0ce2fabae542 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:22.547780 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9c333f40-e475-4871-80d7-0ce2fabae542 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:22.548334 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9c333f40-e475-4871-80d7-0ce2fabae542 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:22.549038 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9c333f40-e475-4871-80d7-0ce2fabae542 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:22.700014 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-9c333f40-e475-4871-80d7-0ce2fabae542 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddef6f6009e4c638b3c0f0cc2d4ccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55d5d8b72b4cf3b348995f49e96c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:22.712439 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-9c333f40-e475-4871-80d7-0ce2fabae542 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] 10.222.0.42 "GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26" status: 200 len: 1315 microversion: 2.1 time: 0.178548 Oct 26 11:21:22.714191 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-4cfe59b0-ddc5-4379-8265-4f28a65d31f3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:22.714945 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-4cfe59b0-ddc5-4379-8265-4f28a65d31f3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:22.719942 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 220/426] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:22 2022] GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:22.727253 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4cfe59b0-ddc5-4379-8265-4f28a65d31f3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:22.729821 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4cfe59b0-ddc5-4379-8265-4f28a65d31f3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:22.730418 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4cfe59b0-ddc5-4379-8265-4f28a65d31f3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:22.733741 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4cfe59b0-ddc5-4379-8265-4f28a65d31f3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:22.734374 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4cfe59b0-ddc5-4379-8265-4f28a65d31f3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:22.735185 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4cfe59b0-ddc5-4379-8265-4f28a65d31f3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:23.006790 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-4cfe59b0-ddc5-4379-8265-4f28a65d31f3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:23.015656 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-4cfe59b0-ddc5-4379-8265-4f28a65d31f3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1267 microversion: 2.1 time: 0.306535 Oct 26 11:21:23.016442 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 207/427] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:22 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1267 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:23.055261 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-884deb59-6d17-424f-8500-fa1082eac96a req-307031e3-70b3-4233-bec3-46e3f0e2413e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f64d1d1-56f2-4ec0-b93a-faceb3411d40", "name": "network-vif-plugged", "status": "completed", "tag": "f2bbf28a-4a02-46b3-af42-40afd907a949"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:21:23.066987 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-884deb59-6d17-424f-8500-fa1082eac96a req-307031e3-70b3-4233-bec3-46e3f0e2413e service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:23.075937 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-884deb59-6d17-424f-8500-fa1082eac96a req-307031e3-70b3-4233-bec3-46e3f0e2413e service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:23.075937 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-884deb59-6d17-424f-8500-fa1082eac96a req-307031e3-70b3-4233-bec3-46e3f0e2413e service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:23.083766 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-884deb59-6d17-424f-8500-fa1082eac96a req-307031e3-70b3-4233-bec3-46e3f0e2413e service nova] Creating event network-vif-plugged:f2bbf28a-4a02-46b3-af42-40afd907a949 for instance 1f64d1d1-56f2-4ec0-b93a-faceb3411d40 on hv-cinder-81558 Oct 26 11:21:23.090061 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-884deb59-6d17-424f-8500-fa1082eac96a req-307031e3-70b3-4233-bec3-46e3f0e2413e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039321 Oct 26 11:21:23.091968 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 221/428] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:21:23.750802 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-dae21fad-fa8c-4971-b2fe-b5f401de83df tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:23.752082 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-dae21fad-fa8c-4971-b2fe-b5f401de83df tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] [instance: f56cb0b4-cb10-4cd6-967b-1cd875517f26] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:23.754314 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell0:SELECT=2 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:21:23.760442 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-dae21fad-fa8c-4971-b2fe-b5f401de83df tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:23.761142 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-dae21fad-fa8c-4971-b2fe-b5f401de83df tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:23.761803 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-dae21fad-fa8c-4971-b2fe-b5f401de83df tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:23.762561 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-dae21fad-fa8c-4971-b2fe-b5f401de83df tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:23.763230 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-dae21fad-fa8c-4971-b2fe-b5f401de83df tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:23.763826 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-dae21fad-fa8c-4971-b2fe-b5f401de83df tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:23.914747 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-dae21fad-fa8c-4971-b2fe-b5f401de83df tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddef6f6009e4c638b3c0f0cc2d4ccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55d5d8b72b4cf3b348995f49e96c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:23.925147 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-dae21fad-fa8c-4971-b2fe-b5f401de83df tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] 10.222.0.42 "GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26" status: 200 len: 1315 microversion: 2.1 time: 0.184021 Oct 26 11:21:23.925725 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 208/429] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:23 2022] GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:24.041602 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-55292458-361f-44fc-98df-fc27c752f91c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:24.042423 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-55292458-361f-44fc-98df-fc27c752f91c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:24.045438 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell0:SELECT=2 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:21:24.046095 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell0:SELECT=6 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:21:24.051333 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-55292458-361f-44fc-98df-fc27c752f91c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:24.052086 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-55292458-361f-44fc-98df-fc27c752f91c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:24.052521 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-55292458-361f-44fc-98df-fc27c752f91c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:24.053226 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-55292458-361f-44fc-98df-fc27c752f91c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:24.053677 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-55292458-361f-44fc-98df-fc27c752f91c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:24.054097 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-55292458-361f-44fc-98df-fc27c752f91c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:24.202005 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-55292458-361f-44fc-98df-fc27c752f91c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:24.214534 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-55292458-361f-44fc-98df-fc27c752f91c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1267 microversion: 2.1 time: 0.176974 Oct 26 11:21:24.215076 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 222/430] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:24 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:24.953423 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-26158ba0-9100-43bd-a3e5-d4df2f2fa2e5 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:24.954790 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-26158ba0-9100-43bd-a3e5-d4df2f2fa2e5 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] [instance: f56cb0b4-cb10-4cd6-967b-1cd875517f26] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:24.961237 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-26158ba0-9100-43bd-a3e5-d4df2f2fa2e5 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:24.961713 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-26158ba0-9100-43bd-a3e5-d4df2f2fa2e5 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:24.962334 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-26158ba0-9100-43bd-a3e5-d4df2f2fa2e5 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:24.963052 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-26158ba0-9100-43bd-a3e5-d4df2f2fa2e5 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:24.963550 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-26158ba0-9100-43bd-a3e5-d4df2f2fa2e5 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:24.963919 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-26158ba0-9100-43bd-a3e5-d4df2f2fa2e5 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:25.100286 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-26158ba0-9100-43bd-a3e5-d4df2f2fa2e5 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddef6f6009e4c638b3c0f0cc2d4ccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55d5d8b72b4cf3b348995f49e96c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:25.108562 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-26158ba0-9100-43bd-a3e5-d4df2f2fa2e5 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] 10.222.0.42 "GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26" status: 200 len: 1315 microversion: 2.1 time: 0.158965 Oct 26 11:21:25.112447 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 209/431] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:24 2022] GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:25.255183 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-9c595aea-e33e-41ed-a35e-d4851bb0a1e1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:25.256539 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-9c595aea-e33e-41ed-a35e-d4851bb0a1e1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:25.263166 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9c595aea-e33e-41ed-a35e-d4851bb0a1e1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:25.263903 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9c595aea-e33e-41ed-a35e-d4851bb0a1e1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:25.264576 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9c595aea-e33e-41ed-a35e-d4851bb0a1e1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:25.265492 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9c595aea-e33e-41ed-a35e-d4851bb0a1e1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:25.266012 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9c595aea-e33e-41ed-a35e-d4851bb0a1e1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:25.266500 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9c595aea-e33e-41ed-a35e-d4851bb0a1e1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:25.406241 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-9c595aea-e33e-41ed-a35e-d4851bb0a1e1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:25.414557 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-9c595aea-e33e-41ed-a35e-d4851bb0a1e1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1267 microversion: 2.1 time: 0.163296 Oct 26 11:21:25.415681 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 223/432] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:25 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:26.132122 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-8f06cc2a-387a-49c5-9897-998948c56c38 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:26.133064 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-8f06cc2a-387a-49c5-9897-998948c56c38 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] [instance: f56cb0b4-cb10-4cd6-967b-1cd875517f26] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:26.140550 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8f06cc2a-387a-49c5-9897-998948c56c38 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:26.141035 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8f06cc2a-387a-49c5-9897-998948c56c38 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:26.141697 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8f06cc2a-387a-49c5-9897-998948c56c38 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:26.142401 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8f06cc2a-387a-49c5-9897-998948c56c38 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:26.142900 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8f06cc2a-387a-49c5-9897-998948c56c38 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:26.143628 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8f06cc2a-387a-49c5-9897-998948c56c38 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:26.289542 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-8f06cc2a-387a-49c5-9897-998948c56c38 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddef6f6009e4c638b3c0f0cc2d4ccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55d5d8b72b4cf3b348995f49e96c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:26.299794 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-8f06cc2a-387a-49c5-9897-998948c56c38 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] 10.222.0.42 "GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26" status: 200 len: 1315 microversion: 2.1 time: 0.171613 Oct 26 11:21:26.300479 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 210/433] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:26 2022] GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:26.441812 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-d7813d9e-b6f4-47f0-b18b-ce7dccfa4d01 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:26.442368 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-d7813d9e-b6f4-47f0-b18b-ce7dccfa4d01 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:26.451428 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d7813d9e-b6f4-47f0-b18b-ce7dccfa4d01 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:26.451920 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d7813d9e-b6f4-47f0-b18b-ce7dccfa4d01 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:26.452358 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d7813d9e-b6f4-47f0-b18b-ce7dccfa4d01 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:26.453060 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d7813d9e-b6f4-47f0-b18b-ce7dccfa4d01 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:26.453516 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d7813d9e-b6f4-47f0-b18b-ce7dccfa4d01 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:26.453940 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d7813d9e-b6f4-47f0-b18b-ce7dccfa4d01 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:26.608687 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-d7813d9e-b6f4-47f0-b18b-ce7dccfa4d01 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:26.618198 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-d7813d9e-b6f4-47f0-b18b-ce7dccfa4d01 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1267 microversion: 2.1 time: 0.184065 Oct 26 11:21:26.618895 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 224/434] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:26 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:21:27.324763 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-0d17e4c3-737c-44af-99e8-780da0afc7bc tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:27.327721 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-0d17e4c3-737c-44af-99e8-780da0afc7bc tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] [instance: f56cb0b4-cb10-4cd6-967b-1cd875517f26] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:27.337287 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0d17e4c3-737c-44af-99e8-780da0afc7bc tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:27.338805 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0d17e4c3-737c-44af-99e8-780da0afc7bc tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:27.338805 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0d17e4c3-737c-44af-99e8-780da0afc7bc tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:27.339071 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0d17e4c3-737c-44af-99e8-780da0afc7bc tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:27.339497 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0d17e4c3-737c-44af-99e8-780da0afc7bc tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:27.340009 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0d17e4c3-737c-44af-99e8-780da0afc7bc tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:27.472464 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-0d17e4c3-737c-44af-99e8-780da0afc7bc tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddef6f6009e4c638b3c0f0cc2d4ccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55d5d8b72b4cf3b348995f49e96c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:27.480427 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-0d17e4c3-737c-44af-99e8-780da0afc7bc tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] 10.222.0.42 "GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26" status: 200 len: 1315 microversion: 2.1 time: 0.160372 Oct 26 11:21:27.480999 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 211/435] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:27 2022] GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:27.642414 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-b4016608-65ad-4f4a-b677-e7d2c2dec6c7 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:27.643709 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-b4016608-65ad-4f4a-b677-e7d2c2dec6c7 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:27.650178 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b4016608-65ad-4f4a-b677-e7d2c2dec6c7 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:27.650985 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b4016608-65ad-4f4a-b677-e7d2c2dec6c7 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:27.651455 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b4016608-65ad-4f4a-b677-e7d2c2dec6c7 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:27.652213 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b4016608-65ad-4f4a-b677-e7d2c2dec6c7 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:27.652673 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b4016608-65ad-4f4a-b677-e7d2c2dec6c7 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:27.653102 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b4016608-65ad-4f4a-b677-e7d2c2dec6c7 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:27.813058 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-b4016608-65ad-4f4a-b677-e7d2c2dec6c7 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:27.823041 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-b4016608-65ad-4f4a-b677-e7d2c2dec6c7 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1267 microversion: 2.1 time: 0.184589 Oct 26 11:21:27.823652 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 225/436] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:27 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:28.504068 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-155482a3-956a-4117-990a-71954f9f4306 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:28.504683 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-155482a3-956a-4117-990a-71954f9f4306 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] [instance: f56cb0b4-cb10-4cd6-967b-1cd875517f26] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:28.511235 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-155482a3-956a-4117-990a-71954f9f4306 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:28.511711 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-155482a3-956a-4117-990a-71954f9f4306 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:28.512138 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-155482a3-956a-4117-990a-71954f9f4306 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:28.513577 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-155482a3-956a-4117-990a-71954f9f4306 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:28.514238 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-155482a3-956a-4117-990a-71954f9f4306 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:28.514659 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-155482a3-956a-4117-990a-71954f9f4306 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:28.649469 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-155482a3-956a-4117-990a-71954f9f4306 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddef6f6009e4c638b3c0f0cc2d4ccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55d5d8b72b4cf3b348995f49e96c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:28.659051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-155482a3-956a-4117-990a-71954f9f4306 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] 10.222.0.42 "GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26" status: 200 len: 1315 microversion: 2.1 time: 0.158682 Oct 26 11:21:28.659670 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 212/437] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:28 2022] GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:28.852589 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-63187e7e-feb1-4555-a05b-1989be635fd3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:28.854738 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-63187e7e-feb1-4555-a05b-1989be635fd3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:28.868314 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-63187e7e-feb1-4555-a05b-1989be635fd3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:28.868956 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-63187e7e-feb1-4555-a05b-1989be635fd3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:28.870701 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-63187e7e-feb1-4555-a05b-1989be635fd3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:28.871706 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-63187e7e-feb1-4555-a05b-1989be635fd3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:28.873381 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-63187e7e-feb1-4555-a05b-1989be635fd3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:28.874105 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-63187e7e-feb1-4555-a05b-1989be635fd3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:29.046573 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-63187e7e-feb1-4555-a05b-1989be635fd3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:29.055016 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-63187e7e-feb1-4555-a05b-1989be635fd3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1267 microversion: 2.1 time: 0.207068 Oct 26 11:21:29.058860 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 226/438] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:28 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1267 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:29.682574 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-31353e58-3357-4773-b83b-64ea61575033 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:29.683356 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-31353e58-3357-4773-b83b-64ea61575033 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] [instance: f56cb0b4-cb10-4cd6-967b-1cd875517f26] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:29.691190 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-31353e58-3357-4773-b83b-64ea61575033 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:29.691711 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-31353e58-3357-4773-b83b-64ea61575033 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:29.692166 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-31353e58-3357-4773-b83b-64ea61575033 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:29.692930 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-31353e58-3357-4773-b83b-64ea61575033 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:29.693451 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-31353e58-3357-4773-b83b-64ea61575033 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:29.693971 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-31353e58-3357-4773-b83b-64ea61575033 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:29.886798 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-31353e58-3357-4773-b83b-64ea61575033 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddef6f6009e4c638b3c0f0cc2d4ccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55d5d8b72b4cf3b348995f49e96c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:29.896001 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-31353e58-3357-4773-b83b-64ea61575033 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] 10.222.0.42 "GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26" status: 200 len: 1315 microversion: 2.1 time: 0.218211 Oct 26 11:21:29.911576 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 213/439] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:29 2022] GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:30.081806 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-18a9429c-0120-4ba6-bd9e-94f654f6548e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:30.083195 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-18a9429c-0120-4ba6-bd9e-94f654f6548e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:30.089745 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-18a9429c-0120-4ba6-bd9e-94f654f6548e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:30.090488 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-18a9429c-0120-4ba6-bd9e-94f654f6548e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:30.091667 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-18a9429c-0120-4ba6-bd9e-94f654f6548e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:30.092694 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-18a9429c-0120-4ba6-bd9e-94f654f6548e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:30.093363 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-18a9429c-0120-4ba6-bd9e-94f654f6548e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:30.093847 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-18a9429c-0120-4ba6-bd9e-94f654f6548e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:30.307671 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-18a9429c-0120-4ba6-bd9e-94f654f6548e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:30.307671 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-18a9429c-0120-4ba6-bd9e-94f654f6548e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1454 microversion: 2.1 time: 0.226070 Oct 26 11:21:30.322773 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 227/440] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:30 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1454 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:30.328189 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-59f24ec4-7ad9-4a4b-9b29-91ca3766f7f7 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:30.328928 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-59f24ec4-7ad9-4a4b-9b29-91ca3766f7f7 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:30.335453 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-59f24ec4-7ad9-4a4b-9b29-91ca3766f7f7 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:30.336037 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-59f24ec4-7ad9-4a4b-9b29-91ca3766f7f7 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:30.336389 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-59f24ec4-7ad9-4a4b-9b29-91ca3766f7f7 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:30.337098 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-59f24ec4-7ad9-4a4b-9b29-91ca3766f7f7 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:30.337555 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-59f24ec4-7ad9-4a4b-9b29-91ca3766f7f7 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:30.337977 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-59f24ec4-7ad9-4a4b-9b29-91ca3766f7f7 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:30.490238 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-59f24ec4-7ad9-4a4b-9b29-91ca3766f7f7 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:30.499475 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-59f24ec4-7ad9-4a4b-9b29-91ca3766f7f7 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1454 microversion: 2.1 time: 0.175174 Oct 26 11:21:30.500256 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 214/441] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:30 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1454 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:30.919406 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-5bb42a2e-b6e5-43c1-9012-ed347574a972 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:30.920794 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-5bb42a2e-b6e5-43c1-9012-ed347574a972 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] [instance: f56cb0b4-cb10-4cd6-967b-1cd875517f26] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:30.929524 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5bb42a2e-b6e5-43c1-9012-ed347574a972 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:30.930542 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5bb42a2e-b6e5-43c1-9012-ed347574a972 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:30.931335 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5bb42a2e-b6e5-43c1-9012-ed347574a972 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:30.932222 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5bb42a2e-b6e5-43c1-9012-ed347574a972 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:30.932834 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5bb42a2e-b6e5-43c1-9012-ed347574a972 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:30.933419 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5bb42a2e-b6e5-43c1-9012-ed347574a972 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:31.082664 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-5bb42a2e-b6e5-43c1-9012-ed347574a972 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddef6f6009e4c638b3c0f0cc2d4ccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55d5d8b72b4cf3b348995f49e96c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:31.094354 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-5bb42a2e-b6e5-43c1-9012-ed347574a972 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] 10.222.0.42 "GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26" status: 200 len: 1315 microversion: 2.1 time: 0.178612 Oct 26 11:21:31.095240 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 228/442] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:30 2022] GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:31.604013 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-a734a44a-4855-4d91-8140-227a6c6ad98e req-d38ffce9-638e-4874-98fa-def87537baa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f56cb0b4-cb10-4cd6-967b-1cd875517f26", "name": "network-vif-plugged", "status": "completed", "tag": "a8c71c23-1cf8-44ad-80e0-6e91d3b6207c"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:21:31.620282 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-a734a44a-4855-4d91-8140-227a6c6ad98e req-d38ffce9-638e-4874-98fa-def87537baa3 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:31.620765 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-a734a44a-4855-4d91-8140-227a6c6ad98e req-d38ffce9-638e-4874-98fa-def87537baa3 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:31.621193 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-a734a44a-4855-4d91-8140-227a6c6ad98e req-d38ffce9-638e-4874-98fa-def87537baa3 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:31.637509 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-a734a44a-4855-4d91-8140-227a6c6ad98e req-d38ffce9-638e-4874-98fa-def87537baa3 service nova] Creating event network-vif-plugged:a8c71c23-1cf8-44ad-80e0-6e91d3b6207c for instance f56cb0b4-cb10-4cd6-967b-1cd875517f26 on hv-cinder-81558 Oct 26 11:21:31.643651 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-a734a44a-4855-4d91-8140-227a6c6ad98e req-d38ffce9-638e-4874-98fa-def87537baa3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044540 Oct 26 11:21:31.645264 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 215/443] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:21:32.120034 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-1d265caa-fc13-454f-a7d6-e956c82f628f tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:32.121715 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-1d265caa-fc13-454f-a7d6-e956c82f628f tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] [instance: f56cb0b4-cb10-4cd6-967b-1cd875517f26] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:32.129869 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1d265caa-fc13-454f-a7d6-e956c82f628f tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:32.131074 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1d265caa-fc13-454f-a7d6-e956c82f628f tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:32.132100 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1d265caa-fc13-454f-a7d6-e956c82f628f tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:32.133545 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1d265caa-fc13-454f-a7d6-e956c82f628f tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:32.134285 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1d265caa-fc13-454f-a7d6-e956c82f628f tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:32.134951 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1d265caa-fc13-454f-a7d6-e956c82f628f tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:32.320722 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-1d265caa-fc13-454f-a7d6-e956c82f628f tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddef6f6009e4c638b3c0f0cc2d4ccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55d5d8b72b4cf3b348995f49e96c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:32.333431 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-1d265caa-fc13-454f-a7d6-e956c82f628f tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] 10.222.0.42 "GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26" status: 200 len: 1315 microversion: 2.1 time: 0.218638 Oct 26 11:21:32.342983 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 229/444] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:32 2022] GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:32.522133 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-45efaa4d-45c0-4234-bd36-55c54f329106 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:32.523035 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-45efaa4d-45c0-4234-bd36-55c54f329106 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:32.532491 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-45efaa4d-45c0-4234-bd36-55c54f329106 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:32.533437 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-45efaa4d-45c0-4234-bd36-55c54f329106 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:32.534192 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-45efaa4d-45c0-4234-bd36-55c54f329106 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:32.535119 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-45efaa4d-45c0-4234-bd36-55c54f329106 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:32.535944 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-45efaa4d-45c0-4234-bd36-55c54f329106 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:32.536740 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-45efaa4d-45c0-4234-bd36-55c54f329106 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:32.585220 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-45efaa4d-45c0-4234-bd36-55c54f329106 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce/ips" status: 200 len: 151 microversion: 2.1 time: 0.073331 Oct 26 11:21:32.586083 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 216/445] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Oct 26 11:21:32 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce/ips => generated 151 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:21:33.368710 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e87ccfad-f4df-4cb2-b921-b77e2abd896b tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:33.371059 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-e87ccfad-f4df-4cb2-b921-b77e2abd896b tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] [instance: f56cb0b4-cb10-4cd6-967b-1cd875517f26] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:33.380602 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-b4195765-6e02-47ed-b4e8-a196806900b4 req-c84bc50d-2433-47aa-94c4-f729c72650a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f64d1d1-56f2-4ec0-b93a-faceb3411d40", "tag": "f2bbf28a-4a02-46b3-af42-40afd907a949"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:21:33.390953 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:21:33.398023 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-b4195765-6e02-47ed-b4e8-a196806900b4 req-c84bc50d-2433-47aa-94c4-f729c72650a7 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:33.398430 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e87ccfad-f4df-4cb2-b921-b77e2abd896b tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:33.406138 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e87ccfad-f4df-4cb2-b921-b77e2abd896b tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:33.406138 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e87ccfad-f4df-4cb2-b921-b77e2abd896b tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:33.406138 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e87ccfad-f4df-4cb2-b921-b77e2abd896b tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:33.406138 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e87ccfad-f4df-4cb2-b921-b77e2abd896b tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:33.406423 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e87ccfad-f4df-4cb2-b921-b77e2abd896b tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:33.406500 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-b4195765-6e02-47ed-b4e8-a196806900b4 req-c84bc50d-2433-47aa-94c4-f729c72650a7 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:33.406500 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-b4195765-6e02-47ed-b4e8-a196806900b4 req-c84bc50d-2433-47aa-94c4-f729c72650a7 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:33.440895 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-b4195765-6e02-47ed-b4e8-a196806900b4 req-c84bc50d-2433-47aa-94c4-f729c72650a7 service nova] Creating event network-changed:f2bbf28a-4a02-46b3-af42-40afd907a949 for instance 1f64d1d1-56f2-4ec0-b93a-faceb3411d40 on hv-cinder-81558 Oct 26 11:21:33.454862 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-b4195765-6e02-47ed-b4e8-a196806900b4 req-c84bc50d-2433-47aa-94c4-f729c72650a7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077063 Oct 26 11:21:33.460926 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 217/446] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:21:33.606204 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-e87ccfad-f4df-4cb2-b921-b77e2abd896b tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddef6f6009e4c638b3c0f0cc2d4ccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55d5d8b72b4cf3b348995f49e96c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:33.614248 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-e87ccfad-f4df-4cb2-b921-b77e2abd896b tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] 10.222.0.42 "GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26" status: 200 len: 1315 microversion: 2.1 time: 0.252316 Oct 26 11:21:33.614848 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 230/447] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:33 2022] GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:34.637744 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-f007ae87-9832-466b-99c8-e22137076692 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:34.638439 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-f007ae87-9832-466b-99c8-e22137076692 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] [instance: f56cb0b4-cb10-4cd6-967b-1cd875517f26] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:34.641274 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_api:SELECT=66 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:21:34.646222 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f007ae87-9832-466b-99c8-e22137076692 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:34.646724 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f007ae87-9832-466b-99c8-e22137076692 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:34.648047 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f007ae87-9832-466b-99c8-e22137076692 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:34.648047 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f007ae87-9832-466b-99c8-e22137076692 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:34.648293 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f007ae87-9832-466b-99c8-e22137076692 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:34.649235 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f007ae87-9832-466b-99c8-e22137076692 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:34.781172 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-f007ae87-9832-466b-99c8-e22137076692 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddef6f6009e4c638b3c0f0cc2d4ccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55d5d8b72b4cf3b348995f49e96c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:34.789353 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-f007ae87-9832-466b-99c8-e22137076692 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] 10.222.0.42 "GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26" status: 200 len: 1464 microversion: 2.1 time: 0.155942 Oct 26 11:21:34.790108 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 218/448] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:34 2022] GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26 => generated 1464 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:34.837293 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-ceb2a1c3-dc7c-4971-970c-758230b7eef4 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:34.837800 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-ceb2a1c3-dc7c-4971-970c-758230b7eef4 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] [instance: f56cb0b4-cb10-4cd6-967b-1cd875517f26] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:34.844558 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ceb2a1c3-dc7c-4971-970c-758230b7eef4 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:34.845035 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ceb2a1c3-dc7c-4971-970c-758230b7eef4 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:34.845464 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ceb2a1c3-dc7c-4971-970c-758230b7eef4 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:34.846147 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ceb2a1c3-dc7c-4971-970c-758230b7eef4 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:34.846599 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ceb2a1c3-dc7c-4971-970c-758230b7eef4 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:34.847058 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ceb2a1c3-dc7c-4971-970c-758230b7eef4 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:34.872361 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-ceb2a1c3-dc7c-4971-970c-758230b7eef4 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] [instance: f56cb0b4-cb10-4cd6-967b-1cd875517f26] Going to try to terminate instance {{(pid=119306) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 11:21:35.127499 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-ceb2a1c3-dc7c-4971-970c-758230b7eef4 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26" status: 204 len: 0 microversion: 2.1 time: 0.294169 Oct 26 11:21:35.128101 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 231/449] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Oct 26 11:21:34 2022] DELETE /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 11:21:35.136396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-966c7370-c473-4b1d-96ea-9f0132a94e06 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:35.137012 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-966c7370-c473-4b1d-96ea-9f0132a94e06 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] [instance: f56cb0b4-cb10-4cd6-967b-1cd875517f26] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:35.143570 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-966c7370-c473-4b1d-96ea-9f0132a94e06 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:35.144058 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-966c7370-c473-4b1d-96ea-9f0132a94e06 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:35.144500 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-966c7370-c473-4b1d-96ea-9f0132a94e06 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:35.145196 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-966c7370-c473-4b1d-96ea-9f0132a94e06 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:35.145653 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-966c7370-c473-4b1d-96ea-9f0132a94e06 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:35.146077 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-966c7370-c473-4b1d-96ea-9f0132a94e06 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:35.299875 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-966c7370-c473-4b1d-96ea-9f0132a94e06 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddef6f6009e4c638b3c0f0cc2d4ccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55d5d8b72b4cf3b348995f49e96c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:35.307593 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-966c7370-c473-4b1d-96ea-9f0132a94e06 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] 10.222.0.42 "GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26" status: 200 len: 1470 microversion: 2.1 time: 0.175153 Oct 26 11:21:35.308145 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 219/450] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:35 2022] GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26 => generated 1470 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:35.476516 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-6c2f8123-9195-471a-8c66-807fc617b29a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b3e9ee3-bf23-476f-b058-a1a30b798b8b"}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:21:35.478945 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-6c2f8123-9195-471a-8c66-807fc617b29a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:35.484802 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6c2f8123-9195-471a-8c66-807fc617b29a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:35.485281 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6c2f8123-9195-471a-8c66-807fc617b29a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:35.485713 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6c2f8123-9195-471a-8c66-807fc617b29a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:35.486392 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6c2f8123-9195-471a-8c66-807fc617b29a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:35.486864 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6c2f8123-9195-471a-8c66-807fc617b29a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:35.487287 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6c2f8123-9195-471a-8c66-807fc617b29a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:36.331438 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-367412c1-1578-423f-b983-f39abc4fb014 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:36.334940 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-367412c1-1578-423f-b983-f39abc4fb014 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] [instance: f56cb0b4-cb10-4cd6-967b-1cd875517f26] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:36.338316 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-367412c1-1578-423f-b983-f39abc4fb014 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:36.338804 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-367412c1-1578-423f-b983-f39abc4fb014 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:36.339265 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-367412c1-1578-423f-b983-f39abc4fb014 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:36.339961 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-367412c1-1578-423f-b983-f39abc4fb014 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:36.340414 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-367412c1-1578-423f-b983-f39abc4fb014 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:36.340838 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-367412c1-1578-423f-b983-f39abc4fb014 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:36.473396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-367412c1-1578-423f-b983-f39abc4fb014 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddef6f6009e4c638b3c0f0cc2d4ccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55d5d8b72b4cf3b348995f49e96c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:36.481049 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-367412c1-1578-423f-b983-f39abc4fb014 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] 10.222.0.42 "GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26" status: 200 len: 1470 microversion: 2.1 time: 0.153435 Oct 26 11:21:36.481613 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 220/451] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:36 2022] GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26 => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:21:37.280528 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:21:37.411459 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-6c2f8123-9195-471a-8c66-807fc617b29a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "POST /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.939125 Oct 26 11:21:37.412091 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 232/452] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Oct 26 11:21:35 2022] POST /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce/os-volume_attachments => generated 194 bytes in 1941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:21:37.503998 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-7fc420da-5109-49ef-b5eb-e4c2b1b6469b tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:37.504616 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-7fc420da-5109-49ef-b5eb-e4c2b1b6469b tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] [instance: f56cb0b4-cb10-4cd6-967b-1cd875517f26] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:37.510958 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7fc420da-5109-49ef-b5eb-e4c2b1b6469b tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:37.511589 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7fc420da-5109-49ef-b5eb-e4c2b1b6469b tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:37.512018 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7fc420da-5109-49ef-b5eb-e4c2b1b6469b tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:37.512711 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7fc420da-5109-49ef-b5eb-e4c2b1b6469b tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:37.513175 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7fc420da-5109-49ef-b5eb-e4c2b1b6469b tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:37.513630 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7fc420da-5109-49ef-b5eb-e4c2b1b6469b tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:37.678476 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-7fc420da-5109-49ef-b5eb-e4c2b1b6469b tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddef6f6009e4c638b3c0f0cc2d4ccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55d5d8b72b4cf3b348995f49e96c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:37.686660 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-7fc420da-5109-49ef-b5eb-e4c2b1b6469b tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] 10.222.0.42 "GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26" status: 200 len: 1470 microversion: 2.1 time: 0.186659 Oct 26 11:21:37.687313 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 221/453] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:37 2022] GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26 => generated 1470 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:21:38.192580 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-910fcfbd-f786-4459-ad35-ef6369de812e req-f912d77a-9244-4746-aa28-739f5ae6dd77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f56cb0b4-cb10-4cd6-967b-1cd875517f26", "name": "network-vif-deleted", "tag": "a8c71c23-1cf8-44ad-80e0-6e91d3b6207c"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:21:38.203873 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-910fcfbd-f786-4459-ad35-ef6369de812e req-f912d77a-9244-4746-aa28-739f5ae6dd77 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:38.204528 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-910fcfbd-f786-4459-ad35-ef6369de812e req-f912d77a-9244-4746-aa28-739f5ae6dd77 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:38.206169 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-910fcfbd-f786-4459-ad35-ef6369de812e req-f912d77a-9244-4746-aa28-739f5ae6dd77 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:38.218122 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-910fcfbd-f786-4459-ad35-ef6369de812e req-f912d77a-9244-4746-aa28-739f5ae6dd77 service nova] Creating event network-vif-deleted:a8c71c23-1cf8-44ad-80e0-6e91d3b6207c for instance f56cb0b4-cb10-4cd6-967b-1cd875517f26 on hv-cinder-81558 Oct 26 11:21:38.223756 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-910fcfbd-f786-4459-ad35-ef6369de812e req-f912d77a-9244-4746-aa28-739f5ae6dd77 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036537 Oct 26 11:21:38.224473 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 233/454] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:21:38.709470 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-7b522e47-5d1e-485a-b96d-c1faa5211d82 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:38.710114 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-7b522e47-5d1e-485a-b96d-c1faa5211d82 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] [instance: f56cb0b4-cb10-4cd6-967b-1cd875517f26] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:38.718431 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7b522e47-5d1e-485a-b96d-c1faa5211d82 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:38.718431 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7b522e47-5d1e-485a-b96d-c1faa5211d82 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:38.718431 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7b522e47-5d1e-485a-b96d-c1faa5211d82 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:38.718719 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7b522e47-5d1e-485a-b96d-c1faa5211d82 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:38.719080 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7b522e47-5d1e-485a-b96d-c1faa5211d82 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:38.719500 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7b522e47-5d1e-485a-b96d-c1faa5211d82 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:38.754643 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7b522e47-5d1e-485a-b96d-c1faa5211d82 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:38.755187 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7b522e47-5d1e-485a-b96d-c1faa5211d82 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:38.755622 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7b522e47-5d1e-485a-b96d-c1faa5211d82 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:38.756060 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.objects.instance [None req-7b522e47-5d1e-485a-b96d-c1faa5211d82 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lazy-loading 'fault' on Instance uuid f56cb0b4-cb10-4cd6-967b-1cd875517f26 {{(pid=119305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:21:38.800476 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-7b522e47-5d1e-485a-b96d-c1faa5211d82 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddef6f6009e4c638b3c0f0cc2d4ccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55d5d8b72b4cf3b348995f49e96c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:38.808061 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-7b522e47-5d1e-485a-b96d-c1faa5211d82 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] 10.222.0.42 "GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26" status: 200 len: 1305 microversion: 2.1 time: 0.102588 Oct 26 11:21:38.808627 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 222/455] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:38 2022] GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26 => generated 1305 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:39.834434 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-f46a7033-fcfc-46dd-af1a-4754fbac96b5 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:39.835158 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-f46a7033-fcfc-46dd-af1a-4754fbac96b5 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] [instance: f56cb0b4-cb10-4cd6-967b-1cd875517f26] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:39.841132 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f46a7033-fcfc-46dd-af1a-4754fbac96b5 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:39.841599 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f46a7033-fcfc-46dd-af1a-4754fbac96b5 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:39.842024 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f46a7033-fcfc-46dd-af1a-4754fbac96b5 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:39.842693 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f46a7033-fcfc-46dd-af1a-4754fbac96b5 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:39.843164 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f46a7033-fcfc-46dd-af1a-4754fbac96b5 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:39.843575 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f46a7033-fcfc-46dd-af1a-4754fbac96b5 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:39.873859 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f46a7033-fcfc-46dd-af1a-4754fbac96b5 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:39.874332 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f46a7033-fcfc-46dd-af1a-4754fbac96b5 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:39.874761 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f46a7033-fcfc-46dd-af1a-4754fbac96b5 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:39.875768 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.objects.instance [None req-f46a7033-fcfc-46dd-af1a-4754fbac96b5 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lazy-loading 'fault' on Instance uuid f56cb0b4-cb10-4cd6-967b-1cd875517f26 {{(pid=119306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:21:39.916618 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-f46a7033-fcfc-46dd-af1a-4754fbac96b5 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ddef6f6009e4c638b3c0f0cc2d4ccd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c55d5d8b72b4cf3b348995f49e96c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:39.924372 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-f46a7033-fcfc-46dd-af1a-4754fbac96b5 tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] 10.222.0.42 "GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26" status: 200 len: 1305 microversion: 2.1 time: 0.094634 Oct 26 11:21:39.925216 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 234/456] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:39 2022] GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26 => generated 1305 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:40.948789 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-59bbdcc8-b066-4c4e-a9af-563d8d3be8be tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:40.949398 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-59bbdcc8-b066-4c4e-a9af-563d8d3be8be tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] [instance: f56cb0b4-cb10-4cd6-967b-1cd875517f26] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:40.956433 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-59bbdcc8-b066-4c4e-a9af-563d8d3be8be tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:40.956918 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-59bbdcc8-b066-4c4e-a9af-563d8d3be8be tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:40.957355 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-59bbdcc8-b066-4c4e-a9af-563d8d3be8be tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:40.958083 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-59bbdcc8-b066-4c4e-a9af-563d8d3be8be tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:40.958538 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-59bbdcc8-b066-4c4e-a9af-563d8d3be8be tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:40.958999 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-59bbdcc8-b066-4c4e-a9af-563d8d3be8be tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:40.973698 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.wsgi [None req-59bbdcc8-b066-4c4e-a9af-563d8d3be8be tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] HTTP exception thrown: Instance f56cb0b4-cb10-4cd6-967b-1cd875517f26 could not be found. Oct 26 11:21:40.976854 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-59bbdcc8-b066-4c4e-a9af-563d8d3be8be tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Request method failure captured: Oct 26 11:21:40.976854 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: request: GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26 HTTP/1.1 Oct 26 11:21:40.976854 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept: application/json Oct 26 11:21:40.976854 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept-Encoding: identity Oct 26 11:21:40.976854 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Connection: close Oct 26 11:21:40.976854 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Length: 0 Oct 26 11:21:40.976854 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Type: application/json Oct 26 11:21:40.976854 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Host: 10.222.0.42 Oct 26 11:21:40.976854 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Openstack-System-Scope: None Oct 26 11:21:40.976854 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: User-Agent: python-urllib3/1.26.12 Oct 26 11:21:40.976854 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Auth-Token: gAAAAABjWRgmcM0GWVaEmuNNiZpWw7OUsN0JA3wBDdPR-t7y6HU7HbS3ddGrEuut_SuJk5-iNQrkaacXl4izBlnIVboHYUyBsj6c8Ivc6HKkFzs6WVK-gYRHeZgPqfNUDOFomGM_fdTnlzGu0a0DYcXtf3RxAultax21gL1SMm6zaVQTE15TTLk Oct 26 11:21:40.976854 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Id: None Oct 26 11:21:40.976854 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Name: None Oct 26 11:21:40.976854 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Identity-Status: Confirmed Oct 26 11:21:40.976854 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Is-Admin-Project: True Oct 26 11:21:40.976854 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Id: default Oct 26 11:21:40.976854 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Name: Default Oct 26 11:21:40.976854 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Id: 3c55d5d8b72b4cf3b348995f49e96c5f Oct 26 11:21:40.976854 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Name: tempest-VolumesNegativeTest-37728066 Oct 26 11:21:40.976854 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Role: member,reader Oct 26 11:21:40.976854 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Roles: member,reader Oct 26 11:21:40.978461 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3c55d5d8b72b4cf3b348995f49e96c5f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3c55d5d8b72b4cf3b348995f49e96c5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3c55d5d8b72b4cf3b348995f49e96c5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3c55d5d8b72b4cf3b348995f49e96c5f"}]}] Oct 26 11:21:40.978461 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant: tempest-VolumesNegativeTest-37728066 Oct 26 11:21:40.978461 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Id: 3c55d5d8b72b4cf3b348995f49e96c5f Oct 26 11:21:40.978461 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Name: tempest-VolumesNegativeTest-37728066 Oct 26 11:21:40.978461 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User: tempest-VolumesNegativeTest-37728066-project Oct 26 11:21:40.978461 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Id: default Oct 26 11:21:40.978461 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Name: Default Oct 26 11:21:40.978461 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Id: 3ddef6f6009e4c638b3c0f0cc2d4ccd9 Oct 26 11:21:40.978461 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Name: tempest-VolumesNegativeTest-37728066-project Oct 26 11:21:40.978461 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: method: > Oct 26 11:21:40.978461 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: exception: Instance f56cb0b4-cb10-4cd6-967b-1cd875517f26 could not be found. Oct 26 11:21:40.978461 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: action_args: {'id': 'f56cb0b4-cb10-4cd6-967b-1cd875517f26'} Oct 26 11:21:40.979471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:21:40.979471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:21:40.979471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:21:40.979471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:21:40.979471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:21:40.979471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:21:40.979471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:21:40.979471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:21:40.979471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:21:40.979471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:21:40.979471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f56cb0b4-cb10-4cd6-967b-1cd875517f26 could not be found. Oct 26 11:21:40.979471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:21:40.979471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:21:40.979471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:21:40.979471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:21:40.979471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:21:40.979471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:21:40.979471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:21:40.979471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:21:40.979471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:21:40.980762 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:21:40.980762 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 11:21:40.980762 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 11:21:40.980762 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:21:40.980762 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:21:40.980762 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:21:40.980762 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:21:40.980762 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f56cb0b4-cb10-4cd6-967b-1cd875517f26 could not be found. Oct 26 11:21:40.980762 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:21:40.980762 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:21:40.980762 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:21:40.980762 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:21:40.980762 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:21:40.980762 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:21:40.980762 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:21:40.980762 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:21:40.980762 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f56cb0b4-cb10-4cd6-967b-1cd875517f26 could not be found. Oct 26 11:21:40.980762 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:21:40.981830 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-59bbdcc8-b066-4c4e-a9af-563d8d3be8be tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] Returning 404 to user: Instance f56cb0b4-cb10-4cd6-967b-1cd875517f26 could not be found. {{(pid=119305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:21:40.981830 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-59bbdcc8-b066-4c4e-a9af-563d8d3be8be tempest-VolumesNegativeTest-37728066 tempest-VolumesNegativeTest-37728066-project] 10.222.0.42 "GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26" status: 404 len: 111 microversion: 2.1 time: 0.032464 Oct 26 11:21:40.981830 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 223/457] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:40 2022] GET /compute/v2.1/servers/f56cb0b4-cb10-4cd6-967b-1cd875517f26 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:21:41.796740 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-6601e8aa-cb63-458f-9516-67f6873940d1 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Action: 'create', calling method: .version_select at 0x7f6b9390df70>, body: {"keypair": {"name": "tempest-keypair-709010892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKgJRBO1FH+KQ27Mon56pysq6KNVW703AzHFN7Y7TuW56fYidrLPsKwZH8OXDhMpF/egsqvpR1NTwgnj5xrmUCH6/oBX3ijsCTgevw8Qwo+dWOr6uMz2Xb12Ez7wetSxw=="}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:21:41.812811 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-6601e8aa-cb63-458f-9516-67f6873940d1 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Getting quotas for project 724121c2144843b7adc7e17312613c9d. Resources: {'key_pairs'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:21:41.817077 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-6601e8aa-cb63-458f-9516-67f6873940d1 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Getting quotas for user e031dd9da25146eebb8813dc8bad8b85 and project 724121c2144843b7adc7e17312613c9d. Resources: {'key_pairs'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:21:41.935573 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-6601e8aa-cb63-458f-9516-67f6873940d1 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.142572 Oct 26 11:21:41.936184 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 235/458] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Oct 26 11:21:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:21:43.206399 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a172120b-5169-44e7-b368-c9de2f6db210 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:43.206908 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-a172120b-5169-44e7-b368-c9de2f6db210 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:43.216772 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a172120b-5169-44e7-b368-c9de2f6db210 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:43.217256 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a172120b-5169-44e7-b368-c9de2f6db210 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:43.217690 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a172120b-5169-44e7-b368-c9de2f6db210 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:43.218387 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a172120b-5169-44e7-b368-c9de2f6db210 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:43.218866 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a172120b-5169-44e7-b368-c9de2f6db210 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:43.219276 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a172120b-5169-44e7-b368-c9de2f6db210 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:43.244017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-a172120b-5169-44e7-b368-c9de2f6db210 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a/ips" status: 200 len: 153 microversion: 2.20 time: 0.041866 Oct 26 11:21:43.244600 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 224/459] 10.222.0.42 () {60 vars in 1289 bytes} [Wed Oct 26 11:21:43 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a/ips => generated 153 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 11:21:44.584483 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-fd297979-9c0a-4e30-84c2-23a8b199e117 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-106858546", "imageRef": "ed8b5733-339c-4fa7-9767-abef514cb9f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b6fe9a7-2300-42a7-b12b-879816096b76"}], "security_groups": [{"name": "tempest-securitygroup--119855825"}], "key_name": "tempest-keypair-709010892", "user_data": "}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:21:44.690165 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.network.neutron [None req-fd297979-9c0a-4e30-84c2-23a8b199e117 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] validate_networks() for [('4b6fe9a7-2300-42a7-b12b-879816096b76', None, None, None, None, None)] {{(pid=119306) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 11:21:45.079411 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-fd297979-9c0a-4e30-84c2-23a8b199e117 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Flavor limits 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 11:21:45.079856 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-fd297979-9c0a-4e30-84c2-23a8b199e117 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Image limits 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 11:21:45.080961 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-fd297979-9c0a-4e30-84c2-23a8b199e117 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Flavor pref 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 11:21:45.081295 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-fd297979-9c0a-4e30-84c2-23a8b199e117 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Image pref 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 11:21:45.082021 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-fd297979-9c0a-4e30-84c2-23a8b199e117 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 11:21:45.090911 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fd297979-9c0a-4e30-84c2-23a8b199e117 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:45.091390 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fd297979-9c0a-4e30-84c2-23a8b199e117 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:45.091812 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fd297979-9c0a-4e30-84c2-23a8b199e117 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:45.092607 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fd297979-9c0a-4e30-84c2-23a8b199e117 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:45.093017 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fd297979-9c0a-4e30-84c2-23a8b199e117 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:45.093438 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fd297979-9c0a-4e30-84c2-23a8b199e117 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:45.112550 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-fd297979-9c0a-4e30-84c2-23a8b199e117 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Getting quotas for project 724121c2144843b7adc7e17312613c9d. Resources: {'cores', 'instances', 'ram'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:21:45.116640 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-fd297979-9c0a-4e30-84c2-23a8b199e117 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Getting quotas for user e031dd9da25146eebb8813dc8bad8b85 and project 724121c2144843b7adc7e17312613c9d. Resources: {'cores', 'instances', 'ram'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:21:45.129763 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-fd297979-9c0a-4e30-84c2-23a8b199e117 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Going to run 1 instances... {{(pid=119306) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 11:21:45.132202 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-fd297979-9c0a-4e30-84c2-23a8b199e117 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: a45dcfbe-3437-4feb-a827-dcfc141a24f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed8b5733-339c-4fa7-9767-abef514cb9f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119306) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 11:21:45.296993 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-fd297979-9c0a-4e30-84c2-23a8b199e117 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.717493 Oct 26 11:21:45.297684 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 236/460] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Oct 26 11:21:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 11:21:45.311017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-6db93c25-04d9-4dc4-b7c3-650c3c27e867 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:45.311017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-6db93c25-04d9-4dc4-b7c3-650c3c27e867 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: a45dcfbe-3437-4feb-a827-dcfc141a24f9] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:45.394513 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-6db93c25-04d9-4dc4-b7c3-650c3c27e867 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:45.402703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-6db93c25-04d9-4dc4-b7c3-650c3c27e867 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9" status: 200 len: 1240 microversion: 2.1 time: 0.097375 Oct 26 11:21:45.402928 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 225/461] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:45 2022] GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9 => generated 1240 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:46.429819 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-18b9dbe3-b745-4e76-b95b-5cd96f2ac4d7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:46.430421 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-18b9dbe3-b745-4e76-b95b-5cd96f2ac4d7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: a45dcfbe-3437-4feb-a827-dcfc141a24f9] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:46.438979 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-18b9dbe3-b745-4e76-b95b-5cd96f2ac4d7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:46.439453 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-18b9dbe3-b745-4e76-b95b-5cd96f2ac4d7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:46.440268 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-18b9dbe3-b745-4e76-b95b-5cd96f2ac4d7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:46.441229 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-18b9dbe3-b745-4e76-b95b-5cd96f2ac4d7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:46.441813 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-18b9dbe3-b745-4e76-b95b-5cd96f2ac4d7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:46.442403 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-18b9dbe3-b745-4e76-b95b-5cd96f2ac4d7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:46.518650 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-18b9dbe3-b745-4e76-b95b-5cd96f2ac4d7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:46.526502 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-18b9dbe3-b745-4e76-b95b-5cd96f2ac4d7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9" status: 200 len: 1244 microversion: 2.1 time: 0.100630 Oct 26 11:21:46.527130 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 237/462] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:46 2022] GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9 => generated 1244 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:46.647096 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-521a72ed-e961-49fc-8b73-d5f31b709219 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:21:46.647629 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-521a72ed-e961-49fc-8b73-d5f31b709219 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:46.654610 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-521a72ed-e961-49fc-8b73-d5f31b709219 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:46.655191 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-521a72ed-e961-49fc-8b73-d5f31b709219 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:46.655629 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-521a72ed-e961-49fc-8b73-d5f31b709219 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:46.656327 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-521a72ed-e961-49fc-8b73-d5f31b709219 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:46.656779 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-521a72ed-e961-49fc-8b73-d5f31b709219 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:46.657202 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-521a72ed-e961-49fc-8b73-d5f31b709219 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:46.683807 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.objects.instance [None req-521a72ed-e961-49fc-8b73-d5f31b709219 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lazy-loading 'flavor' on Instance uuid 2821a8ff-1cb6-43c5-9968-1c13e293ad1a {{(pid=119305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:21:46.687713 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=100 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:21:47.197835 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-521a72ed-e961-49fc-8b73-d5f31b709219 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "POST /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a/action" status: 202 len: 0 microversion: 2.20 time: 0.555211 Oct 26 11:21:47.199018 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 226/463] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Oct 26 11:21:46 2022] POST /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a/action => generated 0 bytes in 558 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 11:21:47.207792 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-b5d3b208-16eb-44c8-b55c-48e7706d7bb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:47.208762 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-b5d3b208-16eb-44c8-b55c-48e7706d7bb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:47.217392 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b5d3b208-16eb-44c8-b55c-48e7706d7bb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:47.218386 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b5d3b208-16eb-44c8-b55c-48e7706d7bb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:47.219076 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b5d3b208-16eb-44c8-b55c-48e7706d7bb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:47.220008 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b5d3b208-16eb-44c8-b55c-48e7706d7bb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:47.220676 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b5d3b208-16eb-44c8-b55c-48e7706d7bb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:47.221308 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b5d3b208-16eb-44c8-b55c-48e7706d7bb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:47.424714 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-b5d3b208-16eb-44c8-b55c-48e7706d7bb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:47.435128 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-b5d3b208-16eb-44c8-b55c-48e7706d7bb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:47.436676 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-b5d3b208-16eb-44c8-b55c-48e7706d7bb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:47.437853 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-b5d3b208-16eb-44c8-b55c-48e7706d7bb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1724 microversion: 2.20 time: 0.234562 Oct 26 11:21:47.438660 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 238/464] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:21:47 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 11:21:47.550023 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-19cc511b-a840-429b-8d8f-9261d8bae5ce tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:47.551320 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-19cc511b-a840-429b-8d8f-9261d8bae5ce tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: a45dcfbe-3437-4feb-a827-dcfc141a24f9] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:47.558150 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-19cc511b-a840-429b-8d8f-9261d8bae5ce tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:47.558507 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-19cc511b-a840-429b-8d8f-9261d8bae5ce tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:47.559155 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-19cc511b-a840-429b-8d8f-9261d8bae5ce tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:47.560318 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-19cc511b-a840-429b-8d8f-9261d8bae5ce tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:47.561034 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-19cc511b-a840-429b-8d8f-9261d8bae5ce tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:47.561810 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-19cc511b-a840-429b-8d8f-9261d8bae5ce tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:47.653350 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-19cc511b-a840-429b-8d8f-9261d8bae5ce tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:47.661936 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-19cc511b-a840-429b-8d8f-9261d8bae5ce tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9" status: 200 len: 1292 microversion: 2.1 time: 0.116106 Oct 26 11:21:47.662519 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 227/465] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:47 2022] GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9 => generated 1292 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:48.464238 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-6b613b55-9bf4-4a0c-9012-ccc6e76d021e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:48.464841 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-6b613b55-9bf4-4a0c-9012-ccc6e76d021e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:48.471419 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6b613b55-9bf4-4a0c-9012-ccc6e76d021e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:48.471896 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6b613b55-9bf4-4a0c-9012-ccc6e76d021e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:48.472415 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6b613b55-9bf4-4a0c-9012-ccc6e76d021e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:48.473158 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6b613b55-9bf4-4a0c-9012-ccc6e76d021e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:48.473538 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6b613b55-9bf4-4a0c-9012-ccc6e76d021e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:48.473953 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6b613b55-9bf4-4a0c-9012-ccc6e76d021e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:48.610207 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-6b613b55-9bf4-4a0c-9012-ccc6e76d021e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:48.619718 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-6b613b55-9bf4-4a0c-9012-ccc6e76d021e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:48.621446 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-6b613b55-9bf4-4a0c-9012-ccc6e76d021e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:48.622503 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-6b613b55-9bf4-4a0c-9012-ccc6e76d021e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1724 microversion: 2.20 time: 0.162220 Oct 26 11:21:48.623138 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 239/466] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:21:48 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:21:48.687122 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-fb7650dc-35d6-4706-a44c-6111ed385066 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:48.688001 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-fb7650dc-35d6-4706-a44c-6111ed385066 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: a45dcfbe-3437-4feb-a827-dcfc141a24f9] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:48.695719 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fb7650dc-35d6-4706-a44c-6111ed385066 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:48.696404 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fb7650dc-35d6-4706-a44c-6111ed385066 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:48.696940 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fb7650dc-35d6-4706-a44c-6111ed385066 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:48.698471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fb7650dc-35d6-4706-a44c-6111ed385066 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:48.698471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fb7650dc-35d6-4706-a44c-6111ed385066 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:48.699068 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fb7650dc-35d6-4706-a44c-6111ed385066 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:48.872731 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-fb7650dc-35d6-4706-a44c-6111ed385066 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:48.881156 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-fb7650dc-35d6-4706-a44c-6111ed385066 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9" status: 200 len: 1365 microversion: 2.1 time: 0.199763 Oct 26 11:21:48.881772 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 228/467] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:48 2022] GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9 => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:49.651291 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-5753ab20-ee5d-43b0-bdf0-6f4213908a42 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:49.652222 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-5753ab20-ee5d-43b0-bdf0-6f4213908a42 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:49.659104 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5753ab20-ee5d-43b0-bdf0-6f4213908a42 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:49.659709 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5753ab20-ee5d-43b0-bdf0-6f4213908a42 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:49.660232 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5753ab20-ee5d-43b0-bdf0-6f4213908a42 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:49.661038 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5753ab20-ee5d-43b0-bdf0-6f4213908a42 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:49.661750 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5753ab20-ee5d-43b0-bdf0-6f4213908a42 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:49.662084 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-edfa8a7f-dae7-42fe-bd3a-66c42627947e req-8ac159a7-2c01-46c8-8059-e63066659cce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a45dcfbe-3437-4feb-a827-dcfc141a24f9", "tag": "6a64fdd0-7bad-40da-928f-79e63d46879e"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:21:49.662366 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5753ab20-ee5d-43b0-bdf0-6f4213908a42 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:49.678862 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-edfa8a7f-dae7-42fe-bd3a-66c42627947e req-8ac159a7-2c01-46c8-8059-e63066659cce service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:49.679362 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-edfa8a7f-dae7-42fe-bd3a-66c42627947e req-8ac159a7-2c01-46c8-8059-e63066659cce service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:49.680074 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-edfa8a7f-dae7-42fe-bd3a-66c42627947e req-8ac159a7-2c01-46c8-8059-e63066659cce service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:49.698159 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-edfa8a7f-dae7-42fe-bd3a-66c42627947e req-8ac159a7-2c01-46c8-8059-e63066659cce service nova] Creating event network-changed:6a64fdd0-7bad-40da-928f-79e63d46879e for instance a45dcfbe-3437-4feb-a827-dcfc141a24f9 on hv-cinder-81558 Oct 26 11:21:49.705771 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-edfa8a7f-dae7-42fe-bd3a-66c42627947e req-8ac159a7-2c01-46c8-8059-e63066659cce service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045037 Oct 26 11:21:49.707891 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 229/468] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:21:49.820646 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-5753ab20-ee5d-43b0-bdf0-6f4213908a42 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:49.829115 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-5753ab20-ee5d-43b0-bdf0-6f4213908a42 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:49.830783 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-5753ab20-ee5d-43b0-bdf0-6f4213908a42 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:49.834870 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-5753ab20-ee5d-43b0-bdf0-6f4213908a42 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1724 microversion: 2.20 time: 0.187567 Oct 26 11:21:49.834870 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 240/469] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:21:49 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:21:49.905115 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-022868c3-dd87-4aa0-bd20-64917c62c88e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:49.905846 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-022868c3-dd87-4aa0-bd20-64917c62c88e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: a45dcfbe-3437-4feb-a827-dcfc141a24f9] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:49.912129 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-022868c3-dd87-4aa0-bd20-64917c62c88e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:49.912619 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-022868c3-dd87-4aa0-bd20-64917c62c88e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:49.913056 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-022868c3-dd87-4aa0-bd20-64917c62c88e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:49.913746 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-022868c3-dd87-4aa0-bd20-64917c62c88e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:49.914200 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-022868c3-dd87-4aa0-bd20-64917c62c88e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:49.914629 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-022868c3-dd87-4aa0-bd20-64917c62c88e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:50.117407 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-022868c3-dd87-4aa0-bd20-64917c62c88e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:50.125052 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-022868c3-dd87-4aa0-bd20-64917c62c88e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9" status: 200 len: 1365 microversion: 2.1 time: 0.224325 Oct 26 11:21:50.125638 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 230/470] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:49 2022] GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:21:50.857816 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-413e5f72-11a7-4e68-b88f-fdbdfe01217a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:50.858461 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-413e5f72-11a7-4e68-b88f-fdbdfe01217a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:50.864886 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-413e5f72-11a7-4e68-b88f-fdbdfe01217a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:50.865362 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-413e5f72-11a7-4e68-b88f-fdbdfe01217a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:50.865786 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-413e5f72-11a7-4e68-b88f-fdbdfe01217a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:50.866466 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-413e5f72-11a7-4e68-b88f-fdbdfe01217a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:50.866944 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-413e5f72-11a7-4e68-b88f-fdbdfe01217a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:50.867359 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-413e5f72-11a7-4e68-b88f-fdbdfe01217a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:51.000442 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-413e5f72-11a7-4e68-b88f-fdbdfe01217a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:51.009168 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-413e5f72-11a7-4e68-b88f-fdbdfe01217a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:51.010658 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-413e5f72-11a7-4e68-b88f-fdbdfe01217a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:51.011845 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-413e5f72-11a7-4e68-b88f-fdbdfe01217a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1724 microversion: 2.20 time: 0.157920 Oct 26 11:21:51.012411 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 241/471] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:21:50 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:21:51.149076 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-08c30f9d-ed17-4c66-996b-029e53381bb7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:51.149688 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-08c30f9d-ed17-4c66-996b-029e53381bb7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: a45dcfbe-3437-4feb-a827-dcfc141a24f9] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:51.156329 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-08c30f9d-ed17-4c66-996b-029e53381bb7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:51.156812 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-08c30f9d-ed17-4c66-996b-029e53381bb7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:51.157242 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-08c30f9d-ed17-4c66-996b-029e53381bb7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:51.157986 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-08c30f9d-ed17-4c66-996b-029e53381bb7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:51.158429 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-08c30f9d-ed17-4c66-996b-029e53381bb7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:51.158866 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-08c30f9d-ed17-4c66-996b-029e53381bb7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:51.285365 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-08c30f9d-ed17-4c66-996b-029e53381bb7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:51.293149 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-08c30f9d-ed17-4c66-996b-029e53381bb7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9" status: 200 len: 1365 microversion: 2.1 time: 0.148607 Oct 26 11:21:51.293704 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 231/472] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:51 2022] GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:52.037834 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-b99491a1-ea74-46f7-a4ff-2f4ac8e9d1e0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:52.038447 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-b99491a1-ea74-46f7-a4ff-2f4ac8e9d1e0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:52.044743 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b99491a1-ea74-46f7-a4ff-2f4ac8e9d1e0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:52.045226 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b99491a1-ea74-46f7-a4ff-2f4ac8e9d1e0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:52.045660 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b99491a1-ea74-46f7-a4ff-2f4ac8e9d1e0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:52.046368 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b99491a1-ea74-46f7-a4ff-2f4ac8e9d1e0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:52.046840 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b99491a1-ea74-46f7-a4ff-2f4ac8e9d1e0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:52.047405 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b99491a1-ea74-46f7-a4ff-2f4ac8e9d1e0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:52.176381 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-b99491a1-ea74-46f7-a4ff-2f4ac8e9d1e0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:52.185054 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-b99491a1-ea74-46f7-a4ff-2f4ac8e9d1e0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:52.186512 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-b99491a1-ea74-46f7-a4ff-2f4ac8e9d1e0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:52.187696 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-b99491a1-ea74-46f7-a4ff-2f4ac8e9d1e0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1724 microversion: 2.20 time: 0.153824 Oct 26 11:21:52.188285 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 242/473] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:21:52 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:21:52.316614 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-76e66be8-d06c-462d-b5f1-a7b872512762 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:52.317268 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-76e66be8-d06c-462d-b5f1-a7b872512762 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: a45dcfbe-3437-4feb-a827-dcfc141a24f9] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:52.324519 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-76e66be8-d06c-462d-b5f1-a7b872512762 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:52.325001 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-76e66be8-d06c-462d-b5f1-a7b872512762 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:52.325438 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-76e66be8-d06c-462d-b5f1-a7b872512762 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:52.326123 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-76e66be8-d06c-462d-b5f1-a7b872512762 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:52.326581 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-76e66be8-d06c-462d-b5f1-a7b872512762 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:52.327037 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-76e66be8-d06c-462d-b5f1-a7b872512762 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:52.449761 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-76e66be8-d06c-462d-b5f1-a7b872512762 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:52.457378 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-76e66be8-d06c-462d-b5f1-a7b872512762 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9" status: 200 len: 1365 microversion: 2.1 time: 0.144801 Oct 26 11:21:52.457944 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 232/474] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:52 2022] GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9 => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:53.214286 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-d0b5857c-6cdb-4e77-a39b-9b80e12aae9c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:53.214802 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-d0b5857c-6cdb-4e77-a39b-9b80e12aae9c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:53.221127 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d0b5857c-6cdb-4e77-a39b-9b80e12aae9c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:53.221603 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d0b5857c-6cdb-4e77-a39b-9b80e12aae9c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:53.222032 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d0b5857c-6cdb-4e77-a39b-9b80e12aae9c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:53.222707 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d0b5857c-6cdb-4e77-a39b-9b80e12aae9c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:53.223190 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d0b5857c-6cdb-4e77-a39b-9b80e12aae9c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:53.223608 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d0b5857c-6cdb-4e77-a39b-9b80e12aae9c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:53.347739 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-d0b5857c-6cdb-4e77-a39b-9b80e12aae9c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:53.355651 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-d0b5857c-6cdb-4e77-a39b-9b80e12aae9c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:53.357100 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-d0b5857c-6cdb-4e77-a39b-9b80e12aae9c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:53.358287 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-d0b5857c-6cdb-4e77-a39b-9b80e12aae9c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1724 microversion: 2.20 time: 0.148042 Oct 26 11:21:53.358870 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 243/475] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:21:53 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:21:53.480000 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-39143818-e0f4-46ea-92a7-21528f28b64c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:53.480581 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-39143818-e0f4-46ea-92a7-21528f28b64c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: a45dcfbe-3437-4feb-a827-dcfc141a24f9] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:53.486993 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-39143818-e0f4-46ea-92a7-21528f28b64c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:53.487477 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-39143818-e0f4-46ea-92a7-21528f28b64c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:53.487912 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-39143818-e0f4-46ea-92a7-21528f28b64c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:53.488597 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-39143818-e0f4-46ea-92a7-21528f28b64c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:53.489055 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-39143818-e0f4-46ea-92a7-21528f28b64c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:53.489479 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-39143818-e0f4-46ea-92a7-21528f28b64c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:53.616808 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-39143818-e0f4-46ea-92a7-21528f28b64c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:53.624479 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-39143818-e0f4-46ea-92a7-21528f28b64c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9" status: 200 len: 1365 microversion: 2.1 time: 0.148384 Oct 26 11:21:53.625075 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 233/476] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:53 2022] GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:54.383001 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-298a591e-f276-4941-83c2-60cd517b8d67 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:54.383609 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-298a591e-f276-4941-83c2-60cd517b8d67 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:54.390702 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-298a591e-f276-4941-83c2-60cd517b8d67 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:54.391219 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-298a591e-f276-4941-83c2-60cd517b8d67 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:54.391686 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-298a591e-f276-4941-83c2-60cd517b8d67 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:54.392370 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-298a591e-f276-4941-83c2-60cd517b8d67 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:54.392822 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-298a591e-f276-4941-83c2-60cd517b8d67 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:54.393242 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-298a591e-f276-4941-83c2-60cd517b8d67 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:54.520502 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-298a591e-f276-4941-83c2-60cd517b8d67 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:54.529159 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-298a591e-f276-4941-83c2-60cd517b8d67 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:54.530616 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-298a591e-f276-4941-83c2-60cd517b8d67 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:54.531811 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-298a591e-f276-4941-83c2-60cd517b8d67 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1724 microversion: 2.20 time: 0.152699 Oct 26 11:21:54.532355 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 244/477] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:21:54 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:21:54.647884 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-014f964e-d57f-4e61-b143-e590aa6ebb1c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:54.648406 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-014f964e-d57f-4e61-b143-e590aa6ebb1c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: a45dcfbe-3437-4feb-a827-dcfc141a24f9] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:54.654697 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-014f964e-d57f-4e61-b143-e590aa6ebb1c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:54.655214 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-014f964e-d57f-4e61-b143-e590aa6ebb1c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:54.655650 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-014f964e-d57f-4e61-b143-e590aa6ebb1c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:54.656340 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-014f964e-d57f-4e61-b143-e590aa6ebb1c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:54.656795 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-014f964e-d57f-4e61-b143-e590aa6ebb1c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:54.657223 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-014f964e-d57f-4e61-b143-e590aa6ebb1c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:54.786848 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-014f964e-d57f-4e61-b143-e590aa6ebb1c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:54.794487 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-014f964e-d57f-4e61-b143-e590aa6ebb1c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9" status: 200 len: 1365 microversion: 2.1 time: 0.151098 Oct 26 11:21:54.795080 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 234/478] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:54 2022] GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:55.557550 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e41bf1c3-5505-4ba7-a2d9-45ece13c296d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:55.558167 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-e41bf1c3-5505-4ba7-a2d9-45ece13c296d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:55.560157 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell0:SELECT=2 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:21:55.560859 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell0:SELECT=10 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:21:55.568784 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e41bf1c3-5505-4ba7-a2d9-45ece13c296d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:55.568784 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e41bf1c3-5505-4ba7-a2d9-45ece13c296d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:55.568784 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e41bf1c3-5505-4ba7-a2d9-45ece13c296d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:55.568784 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e41bf1c3-5505-4ba7-a2d9-45ece13c296d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:55.569266 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e41bf1c3-5505-4ba7-a2d9-45ece13c296d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:55.569266 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e41bf1c3-5505-4ba7-a2d9-45ece13c296d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:55.700639 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-e41bf1c3-5505-4ba7-a2d9-45ece13c296d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:55.708651 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-e41bf1c3-5505-4ba7-a2d9-45ece13c296d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:55.710985 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-e41bf1c3-5505-4ba7-a2d9-45ece13c296d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:55.712297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-e41bf1c3-5505-4ba7-a2d9-45ece13c296d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1724 microversion: 2.20 time: 0.158658 Oct 26 11:21:55.726928 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 245/479] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:21:55 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:21:55.817672 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-4130e6bb-a2be-4cfa-a47b-23baf7d9d098 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:55.819029 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-4130e6bb-a2be-4cfa-a47b-23baf7d9d098 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: a45dcfbe-3437-4feb-a827-dcfc141a24f9] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:55.827042 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell0:SELECT=2 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:21:55.827042 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4130e6bb-a2be-4cfa-a47b-23baf7d9d098 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:55.827260 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4130e6bb-a2be-4cfa-a47b-23baf7d9d098 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:55.827602 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4130e6bb-a2be-4cfa-a47b-23baf7d9d098 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:55.828319 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4130e6bb-a2be-4cfa-a47b-23baf7d9d098 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:55.828775 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4130e6bb-a2be-4cfa-a47b-23baf7d9d098 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:55.829198 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4130e6bb-a2be-4cfa-a47b-23baf7d9d098 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:55.957707 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-4130e6bb-a2be-4cfa-a47b-23baf7d9d098 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:55.965346 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-4130e6bb-a2be-4cfa-a47b-23baf7d9d098 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9" status: 200 len: 1365 microversion: 2.1 time: 0.151536 Oct 26 11:21:55.965912 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 235/480] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:55 2022] GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:56.737689 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-14495cf7-7656-4920-b581-fc313df9fb34 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:56.738258 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-14495cf7-7656-4920-b581-fc313df9fb34 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:56.745201 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-14495cf7-7656-4920-b581-fc313df9fb34 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:56.745692 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-14495cf7-7656-4920-b581-fc313df9fb34 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:56.746126 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-14495cf7-7656-4920-b581-fc313df9fb34 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:56.746848 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-14495cf7-7656-4920-b581-fc313df9fb34 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:56.747293 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-14495cf7-7656-4920-b581-fc313df9fb34 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:56.747944 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-14495cf7-7656-4920-b581-fc313df9fb34 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:56.881577 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-14495cf7-7656-4920-b581-fc313df9fb34 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:56.889618 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-14495cf7-7656-4920-b581-fc313df9fb34 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:56.891149 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-14495cf7-7656-4920-b581-fc313df9fb34 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:56.892308 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-14495cf7-7656-4920-b581-fc313df9fb34 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1724 microversion: 2.20 time: 0.158743 Oct 26 11:21:56.892875 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 246/481] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:21:56 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:21:56.988053 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-830fe30e-2dfe-4106-81b8-7ea0e3eae7b0 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:56.988624 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-830fe30e-2dfe-4106-81b8-7ea0e3eae7b0 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: a45dcfbe-3437-4feb-a827-dcfc141a24f9] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:56.994987 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-830fe30e-2dfe-4106-81b8-7ea0e3eae7b0 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:56.995465 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-830fe30e-2dfe-4106-81b8-7ea0e3eae7b0 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:56.995897 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-830fe30e-2dfe-4106-81b8-7ea0e3eae7b0 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:56.996582 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-830fe30e-2dfe-4106-81b8-7ea0e3eae7b0 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:56.997055 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-830fe30e-2dfe-4106-81b8-7ea0e3eae7b0 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:56.997470 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-830fe30e-2dfe-4106-81b8-7ea0e3eae7b0 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:57.124714 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-830fe30e-2dfe-4106-81b8-7ea0e3eae7b0 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:57.132764 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-830fe30e-2dfe-4106-81b8-7ea0e3eae7b0 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9" status: 200 len: 1365 microversion: 2.1 time: 0.148671 Oct 26 11:21:57.133340 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 236/482] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:56 2022] GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:57.830349 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-49199aff-c693-4647-bcd1-04c38923bb7a req-8d2fa088-cb89-4a85-9164-63ae0f8cf9db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a45dcfbe-3437-4feb-a827-dcfc141a24f9", "name": "network-vif-plugged", "status": "completed", "tag": "6a64fdd0-7bad-40da-928f-79e63d46879e"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:21:57.840068 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-49199aff-c693-4647-bcd1-04c38923bb7a req-8d2fa088-cb89-4a85-9164-63ae0f8cf9db service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:57.840546 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-49199aff-c693-4647-bcd1-04c38923bb7a req-8d2fa088-cb89-4a85-9164-63ae0f8cf9db service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:57.840974 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-49199aff-c693-4647-bcd1-04c38923bb7a req-8d2fa088-cb89-4a85-9164-63ae0f8cf9db service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:57.852365 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-49199aff-c693-4647-bcd1-04c38923bb7a req-8d2fa088-cb89-4a85-9164-63ae0f8cf9db service nova] Creating event network-vif-plugged:6a64fdd0-7bad-40da-928f-79e63d46879e for instance a45dcfbe-3437-4feb-a827-dcfc141a24f9 on hv-cinder-81558 Oct 26 11:21:57.857500 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-49199aff-c693-4647-bcd1-04c38923bb7a req-8d2fa088-cb89-4a85-9164-63ae0f8cf9db service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030820 Oct 26 11:21:57.858454 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 247/483] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:21:57.921298 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-7dbce3d4-4275-43ed-8916-646faf4558da tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:57.921298 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-7dbce3d4-4275-43ed-8916-646faf4558da tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:57.924134 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7dbce3d4-4275-43ed-8916-646faf4558da tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:57.924618 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7dbce3d4-4275-43ed-8916-646faf4558da tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:57.925058 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7dbce3d4-4275-43ed-8916-646faf4558da tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:57.925736 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7dbce3d4-4275-43ed-8916-646faf4558da tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:57.926185 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7dbce3d4-4275-43ed-8916-646faf4558da tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:57.926679 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7dbce3d4-4275-43ed-8916-646faf4558da tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:58.059530 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-7dbce3d4-4275-43ed-8916-646faf4558da tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:58.067722 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-7dbce3d4-4275-43ed-8916-646faf4558da tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:58.069151 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-7dbce3d4-4275-43ed-8916-646faf4558da tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:58.070313 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-7dbce3d4-4275-43ed-8916-646faf4558da tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1724 microversion: 2.20 time: 0.157119 Oct 26 11:21:58.070881 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 237/484] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:21:57 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:21:58.158045 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-dbd8679b-3ad1-415d-9bd3-139f378ac550 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:58.158766 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-dbd8679b-3ad1-415d-9bd3-139f378ac550 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: a45dcfbe-3437-4feb-a827-dcfc141a24f9] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:58.165444 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dbd8679b-3ad1-415d-9bd3-139f378ac550 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:58.166619 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dbd8679b-3ad1-415d-9bd3-139f378ac550 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:58.166619 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dbd8679b-3ad1-415d-9bd3-139f378ac550 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:58.167049 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dbd8679b-3ad1-415d-9bd3-139f378ac550 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:58.167505 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dbd8679b-3ad1-415d-9bd3-139f378ac550 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:58.167926 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dbd8679b-3ad1-415d-9bd3-139f378ac550 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:58.301280 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-dbd8679b-3ad1-415d-9bd3-139f378ac550 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:58.309020 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-dbd8679b-3ad1-415d-9bd3-139f378ac550 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9" status: 200 len: 1365 microversion: 2.1 time: 0.155316 Oct 26 11:21:58.309597 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 248/485] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:58 2022] GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:21:59.096701 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-e00f63f8-98b1-4a20-9f67-a7bf776d2d62 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:59.097332 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-e00f63f8-98b1-4a20-9f67-a7bf776d2d62 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:59.103730 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e00f63f8-98b1-4a20-9f67-a7bf776d2d62 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:59.104226 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e00f63f8-98b1-4a20-9f67-a7bf776d2d62 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:59.104631 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e00f63f8-98b1-4a20-9f67-a7bf776d2d62 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:59.105308 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e00f63f8-98b1-4a20-9f67-a7bf776d2d62 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:59.105753 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e00f63f8-98b1-4a20-9f67-a7bf776d2d62 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:59.106175 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e00f63f8-98b1-4a20-9f67-a7bf776d2d62 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:59.233184 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-e00f63f8-98b1-4a20-9f67-a7bf776d2d62 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:59.241623 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-e00f63f8-98b1-4a20-9f67-a7bf776d2d62 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:59.243686 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-e00f63f8-98b1-4a20-9f67-a7bf776d2d62 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:59.244914 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-e00f63f8-98b1-4a20-9f67-a7bf776d2d62 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1724 microversion: 2.20 time: 0.152081 Oct 26 11:21:59.245719 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 238/486] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:21:59 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:21:59.331969 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-5af4a45e-0040-4b42-8487-7e1a2f3bf937 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:21:59.332623 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-5af4a45e-0040-4b42-8487-7e1a2f3bf937 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: a45dcfbe-3437-4feb-a827-dcfc141a24f9] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:21:59.339555 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5af4a45e-0040-4b42-8487-7e1a2f3bf937 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:59.340039 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5af4a45e-0040-4b42-8487-7e1a2f3bf937 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:59.340472 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5af4a45e-0040-4b42-8487-7e1a2f3bf937 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:59.341157 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5af4a45e-0040-4b42-8487-7e1a2f3bf937 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:21:59.341604 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5af4a45e-0040-4b42-8487-7e1a2f3bf937 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:21:59.342026 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5af4a45e-0040-4b42-8487-7e1a2f3bf937 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:21:59.472741 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-5af4a45e-0040-4b42-8487-7e1a2f3bf937 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:21:59.481140 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-5af4a45e-0040-4b42-8487-7e1a2f3bf937 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9" status: 200 len: 1365 microversion: 2.1 time: 0.153136 Oct 26 11:21:59.481715 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 249/487] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:21:59 2022] GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:22:00.270192 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-f4c276e6-1d0b-473c-8250-2b942f6dd8a3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:00.270855 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-f4c276e6-1d0b-473c-8250-2b942f6dd8a3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:00.277782 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f4c276e6-1d0b-473c-8250-2b942f6dd8a3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:00.278262 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f4c276e6-1d0b-473c-8250-2b942f6dd8a3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:00.278689 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f4c276e6-1d0b-473c-8250-2b942f6dd8a3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:00.279410 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f4c276e6-1d0b-473c-8250-2b942f6dd8a3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:00.279857 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f4c276e6-1d0b-473c-8250-2b942f6dd8a3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:00.280274 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f4c276e6-1d0b-473c-8250-2b942f6dd8a3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:00.411672 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-f4c276e6-1d0b-473c-8250-2b942f6dd8a3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:00.420028 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-f4c276e6-1d0b-473c-8250-2b942f6dd8a3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:00.421559 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-f4c276e6-1d0b-473c-8250-2b942f6dd8a3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:00.422747 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-f4c276e6-1d0b-473c-8250-2b942f6dd8a3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1724 microversion: 2.20 time: 0.156566 Oct 26 11:22:00.423333 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 239/488] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:00 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:00.505070 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-1a76a865-d91b-41a1-afb5-c9cd2a53b0f2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:00.505479 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-1a76a865-d91b-41a1-afb5-c9cd2a53b0f2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: a45dcfbe-3437-4feb-a827-dcfc141a24f9] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:00.512379 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1a76a865-d91b-41a1-afb5-c9cd2a53b0f2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:00.512864 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1a76a865-d91b-41a1-afb5-c9cd2a53b0f2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:00.513298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1a76a865-d91b-41a1-afb5-c9cd2a53b0f2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:00.513994 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1a76a865-d91b-41a1-afb5-c9cd2a53b0f2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:00.514444 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1a76a865-d91b-41a1-afb5-c9cd2a53b0f2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:00.514889 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1a76a865-d91b-41a1-afb5-c9cd2a53b0f2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:00.640177 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-1a76a865-d91b-41a1-afb5-c9cd2a53b0f2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:00.647777 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-1a76a865-d91b-41a1-afb5-c9cd2a53b0f2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9" status: 200 len: 1555 microversion: 2.1 time: 0.147045 Oct 26 11:22:00.648354 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 250/489] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:22:00 2022] GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9 => generated 1555 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:22:00.670158 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-79c74ad0-eb86-468b-8f60-33b91d6eeb43 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:00.670683 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-79c74ad0-eb86-468b-8f60-33b91d6eeb43 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: a45dcfbe-3437-4feb-a827-dcfc141a24f9] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:00.676553 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-79c74ad0-eb86-468b-8f60-33b91d6eeb43 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:00.677040 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-79c74ad0-eb86-468b-8f60-33b91d6eeb43 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:00.677481 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-79c74ad0-eb86-468b-8f60-33b91d6eeb43 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:00.678176 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-79c74ad0-eb86-468b-8f60-33b91d6eeb43 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:00.678636 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-79c74ad0-eb86-468b-8f60-33b91d6eeb43 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:00.679126 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-79c74ad0-eb86-468b-8f60-33b91d6eeb43 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:00.756589 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-79c74ad0-eb86-468b-8f60-33b91d6eeb43 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090124 Oct 26 11:22:00.757154 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 240/490] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Oct 26 11:22:00 2022] GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:22:01.449301 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e2c0bafe-7d26-4dd1-bbf9-e79f1b287f44 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:01.449902 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-e2c0bafe-7d26-4dd1-bbf9-e79f1b287f44 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:01.456193 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2c0bafe-7d26-4dd1-bbf9-e79f1b287f44 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:01.456852 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2c0bafe-7d26-4dd1-bbf9-e79f1b287f44 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:01.457288 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2c0bafe-7d26-4dd1-bbf9-e79f1b287f44 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:01.458015 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2c0bafe-7d26-4dd1-bbf9-e79f1b287f44 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:01.458471 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2c0bafe-7d26-4dd1-bbf9-e79f1b287f44 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:01.458927 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2c0bafe-7d26-4dd1-bbf9-e79f1b287f44 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:01.478726 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:01.596166 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-e2c0bafe-7d26-4dd1-bbf9-e79f1b287f44 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:01.604493 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-e2c0bafe-7d26-4dd1-bbf9-e79f1b287f44 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:01.605964 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-e2c0bafe-7d26-4dd1-bbf9-e79f1b287f44 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:01.607155 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-e2c0bafe-7d26-4dd1-bbf9-e79f1b287f44 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1724 microversion: 2.20 time: 0.162551 Oct 26 11:22:01.607723 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 251/491] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:01 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:02.001300 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-66f0f83e-3d2d-45f5-951c-b559e69cdf10 req-7ce3b131-affe-4448-af77-d8846aaacaa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a45dcfbe-3437-4feb-a827-dcfc141a24f9", "tag": "6a64fdd0-7bad-40da-928f-79e63d46879e"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:22:02.011314 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-66f0f83e-3d2d-45f5-951c-b559e69cdf10 req-7ce3b131-affe-4448-af77-d8846aaacaa1 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:02.011786 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-66f0f83e-3d2d-45f5-951c-b559e69cdf10 req-7ce3b131-affe-4448-af77-d8846aaacaa1 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:02.012211 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-66f0f83e-3d2d-45f5-951c-b559e69cdf10 req-7ce3b131-affe-4448-af77-d8846aaacaa1 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:02.023079 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-66f0f83e-3d2d-45f5-951c-b559e69cdf10 req-7ce3b131-affe-4448-af77-d8846aaacaa1 service nova] Creating event network-changed:6a64fdd0-7bad-40da-928f-79e63d46879e for instance a45dcfbe-3437-4feb-a827-dcfc141a24f9 on hv-cinder-81558 Oct 26 11:22:02.028168 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-66f0f83e-3d2d-45f5-951c-b559e69cdf10 req-7ce3b131-affe-4448-af77-d8846aaacaa1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031049 Oct 26 11:22:02.028745 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 241/492] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:22:02.636504 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-92f6dce3-51a7-4ed4-8b53-0784010b76ab tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:02.637723 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-92f6dce3-51a7-4ed4-8b53-0784010b76ab tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:02.645409 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-92f6dce3-51a7-4ed4-8b53-0784010b76ab tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:02.646166 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-92f6dce3-51a7-4ed4-8b53-0784010b76ab tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:02.646770 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-92f6dce3-51a7-4ed4-8b53-0784010b76ab tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:02.648121 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-92f6dce3-51a7-4ed4-8b53-0784010b76ab tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:02.648740 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-92f6dce3-51a7-4ed4-8b53-0784010b76ab tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:02.649322 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-92f6dce3-51a7-4ed4-8b53-0784010b76ab tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:02.786531 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-92f6dce3-51a7-4ed4-8b53-0784010b76ab tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:02.794786 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-92f6dce3-51a7-4ed4-8b53-0784010b76ab tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:02.796365 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-92f6dce3-51a7-4ed4-8b53-0784010b76ab tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:02.797589 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-92f6dce3-51a7-4ed4-8b53-0784010b76ab tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1724 microversion: 2.20 time: 0.166753 Oct 26 11:22:02.798220 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 252/493] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:02 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:03.825535 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-b78165d9-212c-409a-ba2c-fd829ede30ce tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:03.826225 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-b78165d9-212c-409a-ba2c-fd829ede30ce tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:03.832356 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b78165d9-212c-409a-ba2c-fd829ede30ce tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:03.832835 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b78165d9-212c-409a-ba2c-fd829ede30ce tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:03.833264 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b78165d9-212c-409a-ba2c-fd829ede30ce tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:03.833942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b78165d9-212c-409a-ba2c-fd829ede30ce tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:03.834389 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b78165d9-212c-409a-ba2c-fd829ede30ce tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:03.834806 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b78165d9-212c-409a-ba2c-fd829ede30ce tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:03.959663 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-b78165d9-212c-409a-ba2c-fd829ede30ce tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:03.968112 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-b78165d9-212c-409a-ba2c-fd829ede30ce tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:03.969533 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-b78165d9-212c-409a-ba2c-fd829ede30ce tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:03.970669 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-b78165d9-212c-409a-ba2c-fd829ede30ce tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1724 microversion: 2.20 time: 0.150693 Oct 26 11:22:03.971259 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 242/494] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:03 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:04.996796 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-f5915108-018a-4d99-ac4c-52ea02c3eeb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:04.997403 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-f5915108-018a-4d99-ac4c-52ea02c3eeb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:04.999726 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:05.004314 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f5915108-018a-4d99-ac4c-52ea02c3eeb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:05.004793 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f5915108-018a-4d99-ac4c-52ea02c3eeb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:05.005228 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f5915108-018a-4d99-ac4c-52ea02c3eeb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:05.005915 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f5915108-018a-4d99-ac4c-52ea02c3eeb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:05.006367 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f5915108-018a-4d99-ac4c-52ea02c3eeb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:05.006788 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f5915108-018a-4d99-ac4c-52ea02c3eeb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:05.136213 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-f5915108-018a-4d99-ac4c-52ea02c3eeb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:05.144437 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-f5915108-018a-4d99-ac4c-52ea02c3eeb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:05.145894 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-f5915108-018a-4d99-ac4c-52ea02c3eeb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:05.147074 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-f5915108-018a-4d99-ac4c-52ea02c3eeb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1724 microversion: 2.20 time: 0.154675 Oct 26 11:22:05.147629 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 253/495] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:04 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:06.172868 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-4e3a705d-c5d6-4859-9eac-4cec370c4685 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:06.173619 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-4e3a705d-c5d6-4859-9eac-4cec370c4685 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:06.179522 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_api:SELECT=54 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:06.188008 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4e3a705d-c5d6-4859-9eac-4cec370c4685 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:06.188008 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4e3a705d-c5d6-4859-9eac-4cec370c4685 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:06.188008 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4e3a705d-c5d6-4859-9eac-4cec370c4685 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:06.188008 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4e3a705d-c5d6-4859-9eac-4cec370c4685 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:06.188305 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4e3a705d-c5d6-4859-9eac-4cec370c4685 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:06.188305 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4e3a705d-c5d6-4859-9eac-4cec370c4685 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:06.189498 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:06.316664 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-4e3a705d-c5d6-4859-9eac-4cec370c4685 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:06.325653 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-4e3a705d-c5d6-4859-9eac-4cec370c4685 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:06.327183 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-4e3a705d-c5d6-4859-9eac-4cec370c4685 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:06.328342 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-4e3a705d-c5d6-4859-9eac-4cec370c4685 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1724 microversion: 2.20 time: 0.159354 Oct 26 11:22:06.328911 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 243/496] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:06 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:07.353534 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-5f3916db-a0f8-4b43-89ef-4f36e914c761 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:07.354075 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-5f3916db-a0f8-4b43-89ef-4f36e914c761 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:07.360411 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5f3916db-a0f8-4b43-89ef-4f36e914c761 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:07.360888 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5f3916db-a0f8-4b43-89ef-4f36e914c761 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:07.361320 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5f3916db-a0f8-4b43-89ef-4f36e914c761 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:07.361997 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5f3916db-a0f8-4b43-89ef-4f36e914c761 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:07.362476 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5f3916db-a0f8-4b43-89ef-4f36e914c761 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:07.362985 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5f3916db-a0f8-4b43-89ef-4f36e914c761 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:07.490463 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-5f3916db-a0f8-4b43-89ef-4f36e914c761 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:07.498745 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-5f3916db-a0f8-4b43-89ef-4f36e914c761 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:07.500241 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-5f3916db-a0f8-4b43-89ef-4f36e914c761 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:07.501408 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-5f3916db-a0f8-4b43-89ef-4f36e914c761 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1745 microversion: 2.20 time: 0.151819 Oct 26 11:22:07.501974 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 254/497] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:07 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:08.528030 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-eb6c1b4d-20cb-417d-abbc-968d125ab4d9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:08.528721 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-eb6c1b4d-20cb-417d-abbc-968d125ab4d9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:08.535959 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eb6c1b4d-20cb-417d-abbc-968d125ab4d9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:08.536454 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eb6c1b4d-20cb-417d-abbc-968d125ab4d9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:08.536957 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eb6c1b4d-20cb-417d-abbc-968d125ab4d9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:08.537656 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eb6c1b4d-20cb-417d-abbc-968d125ab4d9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:08.538109 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eb6c1b4d-20cb-417d-abbc-968d125ab4d9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:08.538552 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eb6c1b4d-20cb-417d-abbc-968d125ab4d9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:08.671215 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-eb6c1b4d-20cb-417d-abbc-968d125ab4d9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:08.679299 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-eb6c1b4d-20cb-417d-abbc-968d125ab4d9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:08.680748 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-eb6c1b4d-20cb-417d-abbc-968d125ab4d9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:08.681909 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-eb6c1b4d-20cb-417d-abbc-968d125ab4d9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1745 microversion: 2.20 time: 0.158334 Oct 26 11:22:08.682474 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 244/498] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:08 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:09.707285 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-fc5abf82-2287-4373-b792-0fc4b53a22fc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:09.707915 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-fc5abf82-2287-4373-b792-0fc4b53a22fc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:09.714539 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fc5abf82-2287-4373-b792-0fc4b53a22fc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:09.715714 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fc5abf82-2287-4373-b792-0fc4b53a22fc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:09.716326 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fc5abf82-2287-4373-b792-0fc4b53a22fc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:09.717038 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fc5abf82-2287-4373-b792-0fc4b53a22fc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:09.717498 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fc5abf82-2287-4373-b792-0fc4b53a22fc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:09.717923 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fc5abf82-2287-4373-b792-0fc4b53a22fc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:09.857255 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-fc5abf82-2287-4373-b792-0fc4b53a22fc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:09.865523 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-fc5abf82-2287-4373-b792-0fc4b53a22fc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:09.867000 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-fc5abf82-2287-4373-b792-0fc4b53a22fc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:09.868157 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-fc5abf82-2287-4373-b792-0fc4b53a22fc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1745 microversion: 2.20 time: 0.165137 Oct 26 11:22:09.868716 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 255/499] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:09 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:10.893420 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-b7c4bbcc-e452-411d-9027-5e5f06a4073d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:10.894026 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-b7c4bbcc-e452-411d-9027-5e5f06a4073d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:10.900617 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b7c4bbcc-e452-411d-9027-5e5f06a4073d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:10.901150 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b7c4bbcc-e452-411d-9027-5e5f06a4073d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:10.901615 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b7c4bbcc-e452-411d-9027-5e5f06a4073d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:10.902309 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b7c4bbcc-e452-411d-9027-5e5f06a4073d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:10.903286 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b7c4bbcc-e452-411d-9027-5e5f06a4073d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:10.903756 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b7c4bbcc-e452-411d-9027-5e5f06a4073d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:11.032262 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-b7c4bbcc-e452-411d-9027-5e5f06a4073d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:11.040418 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-b7c4bbcc-e452-411d-9027-5e5f06a4073d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:11.041842 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-b7c4bbcc-e452-411d-9027-5e5f06a4073d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:11.043026 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-b7c4bbcc-e452-411d-9027-5e5f06a4073d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1745 microversion: 2.20 time: 0.153578 Oct 26 11:22:11.044210 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 245/500] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:10 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:11.859625 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-5efe0833-a571-4736-a0ea-612dbbc89c8d req-d1012cdb-1cd8-42e6-be21-5f989ff8bcc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2821a8ff-1cb6-43c5-9968-1c13e293ad1a", "name": "network-vif-plugged", "status": "completed", "tag": "6cd2d732-48e8-4aca-ac57-8f769619a1f1"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:22:11.865727 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-5efe0833-a571-4736-a0ea-612dbbc89c8d req-d1012cdb-1cd8-42e6-be21-5f989ff8bcc6 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:11.866208 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-5efe0833-a571-4736-a0ea-612dbbc89c8d req-d1012cdb-1cd8-42e6-be21-5f989ff8bcc6 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:11.866637 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-5efe0833-a571-4736-a0ea-612dbbc89c8d req-d1012cdb-1cd8-42e6-be21-5f989ff8bcc6 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:11.878379 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-5efe0833-a571-4736-a0ea-612dbbc89c8d req-d1012cdb-1cd8-42e6-be21-5f989ff8bcc6 service nova] Creating event network-vif-plugged:6cd2d732-48e8-4aca-ac57-8f769619a1f1 for instance 2821a8ff-1cb6-43c5-9968-1c13e293ad1a on hv-cinder-81558 Oct 26 11:22:11.883426 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-5efe0833-a571-4736-a0ea-612dbbc89c8d req-d1012cdb-1cd8-42e6-be21-5f989ff8bcc6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032011 Oct 26 11:22:11.884043 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 256/501] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:22:12.069024 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-ad80c4bf-b61e-4699-9f00-15881aaa9f70 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:12.069750 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-ad80c4bf-b61e-4699-9f00-15881aaa9f70 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:12.076752 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ad80c4bf-b61e-4699-9f00-15881aaa9f70 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:12.077259 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ad80c4bf-b61e-4699-9f00-15881aaa9f70 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:12.077702 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ad80c4bf-b61e-4699-9f00-15881aaa9f70 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:12.078497 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ad80c4bf-b61e-4699-9f00-15881aaa9f70 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:12.079013 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ad80c4bf-b61e-4699-9f00-15881aaa9f70 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:12.079442 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ad80c4bf-b61e-4699-9f00-15881aaa9f70 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:12.221618 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-ad80c4bf-b61e-4699-9f00-15881aaa9f70 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:12.229672 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-ad80c4bf-b61e-4699-9f00-15881aaa9f70 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:12.231667 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-ad80c4bf-b61e-4699-9f00-15881aaa9f70 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:12.232883 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-ad80c4bf-b61e-4699-9f00-15881aaa9f70 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1745 microversion: 2.20 time: 0.167921 Oct 26 11:22:12.233443 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 246/502] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:12 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:13.258441 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-f7e52a36-5a8c-4ef6-8740-c264741b18a1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:13.259174 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-f7e52a36-5a8c-4ef6-8740-c264741b18a1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:13.266834 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f7e52a36-5a8c-4ef6-8740-c264741b18a1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:13.267329 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f7e52a36-5a8c-4ef6-8740-c264741b18a1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:13.267761 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f7e52a36-5a8c-4ef6-8740-c264741b18a1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:13.268463 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f7e52a36-5a8c-4ef6-8740-c264741b18a1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:13.268919 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f7e52a36-5a8c-4ef6-8740-c264741b18a1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:13.269339 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f7e52a36-5a8c-4ef6-8740-c264741b18a1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:13.397076 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-f7e52a36-5a8c-4ef6-8740-c264741b18a1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:13.404900 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-f7e52a36-5a8c-4ef6-8740-c264741b18a1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:13.406359 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-f7e52a36-5a8c-4ef6-8740-c264741b18a1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:13.407526 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-f7e52a36-5a8c-4ef6-8740-c264741b18a1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1745 microversion: 2.20 time: 0.153821 Oct 26 11:22:13.408071 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 257/503] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:13 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:14.433997 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-904066a3-49dd-4184-962f-9c10060bdaa7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:14.435124 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-904066a3-49dd-4184-962f-9c10060bdaa7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:14.442048 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-904066a3-49dd-4184-962f-9c10060bdaa7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:14.442523 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-904066a3-49dd-4184-962f-9c10060bdaa7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:14.442985 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-904066a3-49dd-4184-962f-9c10060bdaa7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:14.443672 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-904066a3-49dd-4184-962f-9c10060bdaa7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:14.444126 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-904066a3-49dd-4184-962f-9c10060bdaa7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:14.444535 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-904066a3-49dd-4184-962f-9c10060bdaa7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:14.594537 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-904066a3-49dd-4184-962f-9c10060bdaa7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:14.602539 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-904066a3-49dd-4184-962f-9c10060bdaa7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:14.604080 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-904066a3-49dd-4184-962f-9c10060bdaa7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:14.605290 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-904066a3-49dd-4184-962f-9c10060bdaa7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1740 microversion: 2.20 time: 0.176011 Oct 26 11:22:14.605904 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 247/504] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:14 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:15.633349 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-ffdc6fdd-89c3-41e5-bdc4-a45be7e20cfc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:15.633961 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-ffdc6fdd-89c3-41e5-bdc4-a45be7e20cfc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:15.641255 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ffdc6fdd-89c3-41e5-bdc4-a45be7e20cfc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:15.641753 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ffdc6fdd-89c3-41e5-bdc4-a45be7e20cfc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:15.642216 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ffdc6fdd-89c3-41e5-bdc4-a45be7e20cfc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:15.642949 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ffdc6fdd-89c3-41e5-bdc4-a45be7e20cfc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:15.643407 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ffdc6fdd-89c3-41e5-bdc4-a45be7e20cfc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:15.643832 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ffdc6fdd-89c3-41e5-bdc4-a45be7e20cfc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:15.807976 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ffdc6fdd-89c3-41e5-bdc4-a45be7e20cfc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:15.817037 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ffdc6fdd-89c3-41e5-bdc4-a45be7e20cfc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:15.819409 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ffdc6fdd-89c3-41e5-bdc4-a45be7e20cfc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:15.820586 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-ffdc6fdd-89c3-41e5-bdc4-a45be7e20cfc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1740 microversion: 2.20 time: 0.191189 Oct 26 11:22:15.821147 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 258/505] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:15 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:16.853200 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-963cda59-5622-48d0-909f-4400f34154e2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:16.853901 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-963cda59-5622-48d0-909f-4400f34154e2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:16.871001 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-963cda59-5622-48d0-909f-4400f34154e2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:16.871954 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-963cda59-5622-48d0-909f-4400f34154e2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:16.873225 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-963cda59-5622-48d0-909f-4400f34154e2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:16.874335 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-963cda59-5622-48d0-909f-4400f34154e2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:16.875236 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-963cda59-5622-48d0-909f-4400f34154e2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:16.875875 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-963cda59-5622-48d0-909f-4400f34154e2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:17.016940 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-963cda59-5622-48d0-909f-4400f34154e2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:17.025577 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-963cda59-5622-48d0-909f-4400f34154e2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:17.027059 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-963cda59-5622-48d0-909f-4400f34154e2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:17.028650 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-963cda59-5622-48d0-909f-4400f34154e2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1740 microversion: 2.20 time: 0.179731 Oct 26 11:22:17.029725 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 248/506] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:16 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:18.055842 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-d2efd63e-e8bd-4df0-ad48-0c5e172e7f6b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:18.056386 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-d2efd63e-e8bd-4df0-ad48-0c5e172e7f6b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:18.063927 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d2efd63e-e8bd-4df0-ad48-0c5e172e7f6b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:18.064425 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d2efd63e-e8bd-4df0-ad48-0c5e172e7f6b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:18.064861 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d2efd63e-e8bd-4df0-ad48-0c5e172e7f6b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:18.065552 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d2efd63e-e8bd-4df0-ad48-0c5e172e7f6b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:18.071879 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d2efd63e-e8bd-4df0-ad48-0c5e172e7f6b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:18.072336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d2efd63e-e8bd-4df0-ad48-0c5e172e7f6b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:18.206205 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-d2efd63e-e8bd-4df0-ad48-0c5e172e7f6b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:18.215940 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-d2efd63e-e8bd-4df0-ad48-0c5e172e7f6b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:18.217970 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-d2efd63e-e8bd-4df0-ad48-0c5e172e7f6b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:18.219245 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-d2efd63e-e8bd-4df0-ad48-0c5e172e7f6b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1740 microversion: 2.20 time: 0.167418 Oct 26 11:22:18.219807 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 259/507] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:18 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:19.246374 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-5438d5fe-7413-46ba-992d-2f97aedf6f08 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:19.247194 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-5438d5fe-7413-46ba-992d-2f97aedf6f08 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:19.253910 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5438d5fe-7413-46ba-992d-2f97aedf6f08 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:19.254405 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5438d5fe-7413-46ba-992d-2f97aedf6f08 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:19.254868 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5438d5fe-7413-46ba-992d-2f97aedf6f08 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:19.255778 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5438d5fe-7413-46ba-992d-2f97aedf6f08 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:19.256437 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5438d5fe-7413-46ba-992d-2f97aedf6f08 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:19.256870 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5438d5fe-7413-46ba-992d-2f97aedf6f08 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:19.398316 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-5438d5fe-7413-46ba-992d-2f97aedf6f08 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:19.409962 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-5438d5fe-7413-46ba-992d-2f97aedf6f08 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:19.411633 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-5438d5fe-7413-46ba-992d-2f97aedf6f08 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:19.412792 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-5438d5fe-7413-46ba-992d-2f97aedf6f08 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1740 microversion: 2.20 time: 0.170908 Oct 26 11:22:19.413348 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 249/508] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:19 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:20.438302 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-a3c8f8aa-c657-4d18-b5a3-c976101b471a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:20.438947 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-a3c8f8aa-c657-4d18-b5a3-c976101b471a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:20.445727 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a3c8f8aa-c657-4d18-b5a3-c976101b471a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:20.446213 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a3c8f8aa-c657-4d18-b5a3-c976101b471a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:20.446653 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a3c8f8aa-c657-4d18-b5a3-c976101b471a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:20.447374 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a3c8f8aa-c657-4d18-b5a3-c976101b471a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:20.447821 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a3c8f8aa-c657-4d18-b5a3-c976101b471a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:20.448452 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a3c8f8aa-c657-4d18-b5a3-c976101b471a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:20.585479 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-a3c8f8aa-c657-4d18-b5a3-c976101b471a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:20.594204 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-a3c8f8aa-c657-4d18-b5a3-c976101b471a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:20.595681 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-a3c8f8aa-c657-4d18-b5a3-c976101b471a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:20.596827 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-a3c8f8aa-c657-4d18-b5a3-c976101b471a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1740 microversion: 2.20 time: 0.163193 Oct 26 11:22:20.597557 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 260/509] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:20 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 11:22:21.622002 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-06558e4c-36f5-44cd-ae83-9f7069164da5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:21.623329 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-06558e4c-36f5-44cd-ae83-9f7069164da5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:21.630166 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-06558e4c-36f5-44cd-ae83-9f7069164da5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:21.630665 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-06558e4c-36f5-44cd-ae83-9f7069164da5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:21.631164 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-06558e4c-36f5-44cd-ae83-9f7069164da5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:21.631903 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-06558e4c-36f5-44cd-ae83-9f7069164da5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:21.632497 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-06558e4c-36f5-44cd-ae83-9f7069164da5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:21.632935 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-06558e4c-36f5-44cd-ae83-9f7069164da5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:21.807400 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-06558e4c-36f5-44cd-ae83-9f7069164da5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:21.816088 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-06558e4c-36f5-44cd-ae83-9f7069164da5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:21.817956 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-06558e4c-36f5-44cd-ae83-9f7069164da5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:21.819300 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-06558e4c-36f5-44cd-ae83-9f7069164da5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1740 microversion: 2.20 time: 0.201433 Oct 26 11:22:21.820015 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 250/510] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:21 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:22.852803 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-ea928eee-7cce-4fa6-ab46-8668ec228816 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:22.855226 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-ea928eee-7cce-4fa6-ab46-8668ec228816 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:22.862573 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ea928eee-7cce-4fa6-ab46-8668ec228816 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:22.863099 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ea928eee-7cce-4fa6-ab46-8668ec228816 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:22.863526 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ea928eee-7cce-4fa6-ab46-8668ec228816 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:22.864230 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ea928eee-7cce-4fa6-ab46-8668ec228816 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:22.864676 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ea928eee-7cce-4fa6-ab46-8668ec228816 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:22.865124 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ea928eee-7cce-4fa6-ab46-8668ec228816 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:23.031535 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ea928eee-7cce-4fa6-ab46-8668ec228816 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:23.042010 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ea928eee-7cce-4fa6-ab46-8668ec228816 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:23.043731 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ea928eee-7cce-4fa6-ab46-8668ec228816 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:23.045242 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-ea928eee-7cce-4fa6-ab46-8668ec228816 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1740 microversion: 2.20 time: 0.200035 Oct 26 11:22:23.046104 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 261/511] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:22 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 11:22:24.075173 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-c621fd74-f1a1-41eb-97b9-351b197ef07b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:24.076865 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-c621fd74-f1a1-41eb-97b9-351b197ef07b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:24.083632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c621fd74-f1a1-41eb-97b9-351b197ef07b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:24.084422 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c621fd74-f1a1-41eb-97b9-351b197ef07b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:24.085388 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c621fd74-f1a1-41eb-97b9-351b197ef07b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:24.086451 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c621fd74-f1a1-41eb-97b9-351b197ef07b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:24.087139 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c621fd74-f1a1-41eb-97b9-351b197ef07b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:24.087561 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c621fd74-f1a1-41eb-97b9-351b197ef07b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:24.241476 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-c621fd74-f1a1-41eb-97b9-351b197ef07b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:24.251415 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-c621fd74-f1a1-41eb-97b9-351b197ef07b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:24.253185 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-c621fd74-f1a1-41eb-97b9-351b197ef07b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:24.254501 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-c621fd74-f1a1-41eb-97b9-351b197ef07b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1740 microversion: 2.20 time: 0.183777 Oct 26 11:22:24.255870 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 251/512] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:24 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 11:22:25.281997 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-21988367-e4c3-448b-bc28-beb775e9848d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:25.282569 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-21988367-e4c3-448b-bc28-beb775e9848d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:25.290121 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-21988367-e4c3-448b-bc28-beb775e9848d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:25.290611 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-21988367-e4c3-448b-bc28-beb775e9848d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:25.291072 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-21988367-e4c3-448b-bc28-beb775e9848d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:25.291795 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-21988367-e4c3-448b-bc28-beb775e9848d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:25.292246 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-21988367-e4c3-448b-bc28-beb775e9848d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:25.292665 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-21988367-e4c3-448b-bc28-beb775e9848d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:25.438565 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-21988367-e4c3-448b-bc28-beb775e9848d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:25.447763 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-21988367-e4c3-448b-bc28-beb775e9848d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:25.449217 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-21988367-e4c3-448b-bc28-beb775e9848d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:25.450359 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-21988367-e4c3-448b-bc28-beb775e9848d tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1740 microversion: 2.20 time: 0.172570 Oct 26 11:22:25.450920 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 262/513] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:25 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:26.498312 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-ce3c12b1-8380-4280-a24d-36a49a789626 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:26.505472 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-ce3c12b1-8380-4280-a24d-36a49a789626 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:26.513750 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ce3c12b1-8380-4280-a24d-36a49a789626 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:26.514308 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ce3c12b1-8380-4280-a24d-36a49a789626 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:26.514744 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ce3c12b1-8380-4280-a24d-36a49a789626 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:26.515461 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ce3c12b1-8380-4280-a24d-36a49a789626 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:26.515916 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ce3c12b1-8380-4280-a24d-36a49a789626 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:26.516331 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ce3c12b1-8380-4280-a24d-36a49a789626 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:26.666168 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-ce3c12b1-8380-4280-a24d-36a49a789626 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:26.676502 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-ce3c12b1-8380-4280-a24d-36a49a789626 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:26.677969 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-ce3c12b1-8380-4280-a24d-36a49a789626 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:26.679377 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-ce3c12b1-8380-4280-a24d-36a49a789626 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1740 microversion: 2.20 time: 0.205247 Oct 26 11:22:26.691348 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 252/514] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:26 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:27.705380 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-4f6e820b-395f-4e9c-a9b7-0cbd7fc8ea69 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:27.705967 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-4f6e820b-395f-4e9c-a9b7-0cbd7fc8ea69 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:27.712318 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4f6e820b-395f-4e9c-a9b7-0cbd7fc8ea69 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:27.712792 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4f6e820b-395f-4e9c-a9b7-0cbd7fc8ea69 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:27.713220 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4f6e820b-395f-4e9c-a9b7-0cbd7fc8ea69 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:27.713894 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4f6e820b-395f-4e9c-a9b7-0cbd7fc8ea69 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:27.714339 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4f6e820b-395f-4e9c-a9b7-0cbd7fc8ea69 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:27.714751 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4f6e820b-395f-4e9c-a9b7-0cbd7fc8ea69 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:27.841823 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-4f6e820b-395f-4e9c-a9b7-0cbd7fc8ea69 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:27.850357 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-4f6e820b-395f-4e9c-a9b7-0cbd7fc8ea69 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:27.851868 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-4f6e820b-395f-4e9c-a9b7-0cbd7fc8ea69 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:27.853025 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-4f6e820b-395f-4e9c-a9b7-0cbd7fc8ea69 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1740 microversion: 2.20 time: 0.151612 Oct 26 11:22:27.853587 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 263/515] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:27 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1740 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:28.878268 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-d41e6ac9-c059-4a69-8cb4-f1fe28576cfe tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:28.878985 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-d41e6ac9-c059-4a69-8cb4-f1fe28576cfe tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:28.885651 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d41e6ac9-c059-4a69-8cb4-f1fe28576cfe tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:28.886206 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d41e6ac9-c059-4a69-8cb4-f1fe28576cfe tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:28.886646 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d41e6ac9-c059-4a69-8cb4-f1fe28576cfe tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:28.887358 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d41e6ac9-c059-4a69-8cb4-f1fe28576cfe tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:28.887813 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d41e6ac9-c059-4a69-8cb4-f1fe28576cfe tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:28.888235 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d41e6ac9-c059-4a69-8cb4-f1fe28576cfe tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:29.086515 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-d41e6ac9-c059-4a69-8cb4-f1fe28576cfe tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:29.094474 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-d41e6ac9-c059-4a69-8cb4-f1fe28576cfe tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:29.095931 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-d41e6ac9-c059-4a69-8cb4-f1fe28576cfe tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:29.097072 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-d41e6ac9-c059-4a69-8cb4-f1fe28576cfe tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1722 microversion: 2.20 time: 0.222927 Oct 26 11:22:29.097819 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 253/516] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:28 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:30.123300 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-172ca484-4db6-46c6-92b3-7701cf7d8403 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:30.123904 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-172ca484-4db6-46c6-92b3-7701cf7d8403 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:30.130939 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-172ca484-4db6-46c6-92b3-7701cf7d8403 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:30.131412 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-172ca484-4db6-46c6-92b3-7701cf7d8403 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:30.131838 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-172ca484-4db6-46c6-92b3-7701cf7d8403 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:30.132510 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-172ca484-4db6-46c6-92b3-7701cf7d8403 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:30.132951 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-172ca484-4db6-46c6-92b3-7701cf7d8403 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:30.133366 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-172ca484-4db6-46c6-92b3-7701cf7d8403 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:30.262749 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-172ca484-4db6-46c6-92b3-7701cf7d8403 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:30.271202 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-172ca484-4db6-46c6-92b3-7701cf7d8403 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:30.272647 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-172ca484-4db6-46c6-92b3-7701cf7d8403 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:30.273792 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-172ca484-4db6-46c6-92b3-7701cf7d8403 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1722 microversion: 2.20 time: 0.154442 Oct 26 11:22:30.274346 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 264/517] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:30 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:31.299577 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-e55cb1aa-8e5c-4a71-b13d-29e62251192f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:31.300190 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-e55cb1aa-8e5c-4a71-b13d-29e62251192f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:31.307284 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e55cb1aa-8e5c-4a71-b13d-29e62251192f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:31.313804 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e55cb1aa-8e5c-4a71-b13d-29e62251192f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:31.313804 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e55cb1aa-8e5c-4a71-b13d-29e62251192f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:31.313804 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e55cb1aa-8e5c-4a71-b13d-29e62251192f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:31.313804 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e55cb1aa-8e5c-4a71-b13d-29e62251192f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:31.314152 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e55cb1aa-8e5c-4a71-b13d-29e62251192f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:31.438884 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-e55cb1aa-8e5c-4a71-b13d-29e62251192f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:31.447603 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-e55cb1aa-8e5c-4a71-b13d-29e62251192f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:31.449078 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-e55cb1aa-8e5c-4a71-b13d-29e62251192f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:31.450234 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-e55cb1aa-8e5c-4a71-b13d-29e62251192f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1722 microversion: 2.20 time: 0.154581 Oct 26 11:22:31.451030 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 254/518] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:31 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:31.946620 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-db1eebff-20d4-4b16-9298-50f9b57ee939 req-e0850d2f-1b92-4ef1-8390-1b03cf95bb7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2821a8ff-1cb6-43c5-9968-1c13e293ad1a", "name": "network-vif-unplugged", "status": "completed", "tag": "6cd2d732-48e8-4aca-ac57-8f769619a1f1"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:22:31.956656 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-db1eebff-20d4-4b16-9298-50f9b57ee939 req-e0850d2f-1b92-4ef1-8390-1b03cf95bb7a service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:31.957127 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-db1eebff-20d4-4b16-9298-50f9b57ee939 req-e0850d2f-1b92-4ef1-8390-1b03cf95bb7a service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:31.957550 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-db1eebff-20d4-4b16-9298-50f9b57ee939 req-e0850d2f-1b92-4ef1-8390-1b03cf95bb7a service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:31.960120 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=77 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:31.968695 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-db1eebff-20d4-4b16-9298-50f9b57ee939 req-e0850d2f-1b92-4ef1-8390-1b03cf95bb7a service nova] Creating event network-vif-unplugged:6cd2d732-48e8-4aca-ac57-8f769619a1f1 for instance 2821a8ff-1cb6-43c5-9968-1c13e293ad1a on hv-cinder-81558 Oct 26 11:22:31.974185 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-db1eebff-20d4-4b16-9298-50f9b57ee939 req-e0850d2f-1b92-4ef1-8390-1b03cf95bb7a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031276 Oct 26 11:22:31.974749 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 265/519] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:22:32.476352 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-c857a855-1321-4de3-b3cd-b6f8572ef0fd tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:32.476983 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-c857a855-1321-4de3-b3cd-b6f8572ef0fd tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:32.483307 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c857a855-1321-4de3-b3cd-b6f8572ef0fd tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:32.483784 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c857a855-1321-4de3-b3cd-b6f8572ef0fd tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:32.484214 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c857a855-1321-4de3-b3cd-b6f8572ef0fd tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:32.484887 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c857a855-1321-4de3-b3cd-b6f8572ef0fd tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:32.485333 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c857a855-1321-4de3-b3cd-b6f8572ef0fd tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:32.485748 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c857a855-1321-4de3-b3cd-b6f8572ef0fd tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:32.612776 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-c857a855-1321-4de3-b3cd-b6f8572ef0fd tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:32.620766 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-c857a855-1321-4de3-b3cd-b6f8572ef0fd tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:32.622193 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-c857a855-1321-4de3-b3cd-b6f8572ef0fd tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:32.623392 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-c857a855-1321-4de3-b3cd-b6f8572ef0fd tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1665 microversion: 2.20 time: 0.151005 Oct 26 11:22:32.623943 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 255/520] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:32 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1665 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:32.649271 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-737bf4d9-8fad-43e9-8153-705dfbec9a39 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1ba4fc9-3476-4c47-9d67-f1a17f84c590"}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:22:32.651807 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-737bf4d9-8fad-43e9-8153-705dfbec9a39 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:32.657859 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-737bf4d9-8fad-43e9-8153-705dfbec9a39 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:32.658338 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-737bf4d9-8fad-43e9-8153-705dfbec9a39 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:32.658797 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-737bf4d9-8fad-43e9-8153-705dfbec9a39 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:32.659547 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-737bf4d9-8fad-43e9-8153-705dfbec9a39 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:32.659997 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-737bf4d9-8fad-43e9-8153-705dfbec9a39 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:32.660421 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-737bf4d9-8fad-43e9-8153-705dfbec9a39 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:33.657278 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-737bf4d9-8fad-43e9-8153-705dfbec9a39 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "POST /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.012636 Oct 26 11:22:33.657879 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 266/521] 10.222.0.42 () {62 vars in 1364 bytes} [Wed Oct 26 11:22:32 2022] POST /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a/os-volume_attachments => generated 188 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 11:22:33.783197 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-3d5bd681-010b-4ea8-8fc8-be9416883911 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:22:33.783799 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-3d5bd681-010b-4ea8-8fc8-be9416883911 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:33.790315 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3d5bd681-010b-4ea8-8fc8-be9416883911 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:33.790786 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3d5bd681-010b-4ea8-8fc8-be9416883911 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:33.791273 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3d5bd681-010b-4ea8-8fc8-be9416883911 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:33.792037 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3d5bd681-010b-4ea8-8fc8-be9416883911 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:33.792483 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3d5bd681-010b-4ea8-8fc8-be9416883911 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:33.792901 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3d5bd681-010b-4ea8-8fc8-be9416883911 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:33.836060 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-3d5bd681-010b-4ea8-8fc8-be9416883911 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119305) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 26 11:22:34.047549 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-3d5bd681-010b-4ea8-8fc8-be9416883911 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "POST /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a/action" status: 202 len: 0 microversion: 2.20 time: 0.268028 Oct 26 11:22:34.048752 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 256/522] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Oct 26 11:22:33 2022] POST /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 11:22:34.056766 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-23522e0a-d3f2-42eb-a0c8-d3940b76d73a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:34.057463 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-23522e0a-d3f2-42eb-a0c8-d3940b76d73a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:34.065130 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-23522e0a-d3f2-42eb-a0c8-d3940b76d73a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:34.065682 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-23522e0a-d3f2-42eb-a0c8-d3940b76d73a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:34.066115 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-23522e0a-d3f2-42eb-a0c8-d3940b76d73a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:34.066951 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-23522e0a-d3f2-42eb-a0c8-d3940b76d73a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:34.067398 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-23522e0a-d3f2-42eb-a0c8-d3940b76d73a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:34.067816 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-23522e0a-d3f2-42eb-a0c8-d3940b76d73a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:34.199321 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-23522e0a-d3f2-42eb-a0c8-d3940b76d73a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:34.207994 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-23522e0a-d3f2-42eb-a0c8-d3940b76d73a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:34.209533 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-23522e0a-d3f2-42eb-a0c8-d3940b76d73a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:34.210661 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-23522e0a-d3f2-42eb-a0c8-d3940b76d73a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1751 microversion: 2.20 time: 0.157930 Oct 26 11:22:34.211249 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 267/523] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:34 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:35.237048 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-ec0363fd-b114-4692-87cc-21642009de58 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:35.237657 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-ec0363fd-b114-4692-87cc-21642009de58 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:35.244101 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ec0363fd-b114-4692-87cc-21642009de58 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:35.244583 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ec0363fd-b114-4692-87cc-21642009de58 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:35.245016 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ec0363fd-b114-4692-87cc-21642009de58 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:35.245714 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ec0363fd-b114-4692-87cc-21642009de58 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:35.246167 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ec0363fd-b114-4692-87cc-21642009de58 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:35.246590 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ec0363fd-b114-4692-87cc-21642009de58 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:35.616860 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-ec0363fd-b114-4692-87cc-21642009de58 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:35.625512 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-ec0363fd-b114-4692-87cc-21642009de58 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:35.626967 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-ec0363fd-b114-4692-87cc-21642009de58 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:35.628124 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-ec0363fd-b114-4692-87cc-21642009de58 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1751 microversion: 2.20 time: 0.395671 Oct 26 11:22:35.628870 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 257/524] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:35 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1751 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:36.653352 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-efde7d32-b5ca-4e92-af72-17e0d9025006 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:36.653946 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-efde7d32-b5ca-4e92-af72-17e0d9025006 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:36.656578 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=30 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:36.661129 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-efde7d32-b5ca-4e92-af72-17e0d9025006 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:36.661616 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-efde7d32-b5ca-4e92-af72-17e0d9025006 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:36.662059 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-efde7d32-b5ca-4e92-af72-17e0d9025006 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:36.662732 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-efde7d32-b5ca-4e92-af72-17e0d9025006 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:36.663205 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-efde7d32-b5ca-4e92-af72-17e0d9025006 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:36.663625 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-efde7d32-b5ca-4e92-af72-17e0d9025006 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:36.797232 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-efde7d32-b5ca-4e92-af72-17e0d9025006 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:36.805526 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-efde7d32-b5ca-4e92-af72-17e0d9025006 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:36.807340 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-efde7d32-b5ca-4e92-af72-17e0d9025006 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:36.808496 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-efde7d32-b5ca-4e92-af72-17e0d9025006 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1753 microversion: 2.20 time: 0.159100 Oct 26 11:22:36.809071 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 268/525] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:36 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:37.835126 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-13254d31-9db7-4815-93ae-42e5dd65a34f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:37.835737 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-13254d31-9db7-4815-93ae-42e5dd65a34f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:37.837987 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:37.842589 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-13254d31-9db7-4815-93ae-42e5dd65a34f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:37.843094 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-13254d31-9db7-4815-93ae-42e5dd65a34f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:37.843535 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-13254d31-9db7-4815-93ae-42e5dd65a34f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:37.844899 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-13254d31-9db7-4815-93ae-42e5dd65a34f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:37.845348 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-13254d31-9db7-4815-93ae-42e5dd65a34f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:37.845767 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-13254d31-9db7-4815-93ae-42e5dd65a34f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:38.032141 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-13254d31-9db7-4815-93ae-42e5dd65a34f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:38.035546 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:22:38.040970 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-13254d31-9db7-4815-93ae-42e5dd65a34f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:38.042423 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-13254d31-9db7-4815-93ae-42e5dd65a34f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:38.043781 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-13254d31-9db7-4815-93ae-42e5dd65a34f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1809 microversion: 2.20 time: 0.212553 Oct 26 11:22:38.044335 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 258/526] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:37 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1809 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:39.069413 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e8131be2-c78f-41b5-9a67-5ac5c017b2bb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:39.070176 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-e8131be2-c78f-41b5-9a67-5ac5c017b2bb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:39.077746 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e8131be2-c78f-41b5-9a67-5ac5c017b2bb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:39.078247 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e8131be2-c78f-41b5-9a67-5ac5c017b2bb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:39.078915 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e8131be2-c78f-41b5-9a67-5ac5c017b2bb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:39.079905 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e8131be2-c78f-41b5-9a67-5ac5c017b2bb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:39.080574 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e8131be2-c78f-41b5-9a67-5ac5c017b2bb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:39.081214 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e8131be2-c78f-41b5-9a67-5ac5c017b2bb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:39.250183 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-e8131be2-c78f-41b5-9a67-5ac5c017b2bb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:39.270456 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-e8131be2-c78f-41b5-9a67-5ac5c017b2bb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:39.273810 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-e8131be2-c78f-41b5-9a67-5ac5c017b2bb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:39.275466 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-e8131be2-c78f-41b5-9a67-5ac5c017b2bb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1809 microversion: 2.20 time: 0.209953 Oct 26 11:22:39.276575 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 269/527] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:39 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1809 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 11:22:40.307509 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-d62dd5a6-63c8-4501-b304-a9938a9dfaac tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:40.308199 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-d62dd5a6-63c8-4501-b304-a9938a9dfaac tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:40.315548 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d62dd5a6-63c8-4501-b304-a9938a9dfaac tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:40.316044 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d62dd5a6-63c8-4501-b304-a9938a9dfaac tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:40.316485 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d62dd5a6-63c8-4501-b304-a9938a9dfaac tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:40.317194 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d62dd5a6-63c8-4501-b304-a9938a9dfaac tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:40.317650 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d62dd5a6-63c8-4501-b304-a9938a9dfaac tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:40.318074 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d62dd5a6-63c8-4501-b304-a9938a9dfaac tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:40.457503 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-d62dd5a6-63c8-4501-b304-a9938a9dfaac tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:40.466413 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-d62dd5a6-63c8-4501-b304-a9938a9dfaac tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:40.468383 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-d62dd5a6-63c8-4501-b304-a9938a9dfaac tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:40.469535 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-d62dd5a6-63c8-4501-b304-a9938a9dfaac tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1809 microversion: 2.20 time: 0.166371 Oct 26 11:22:40.470116 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 259/528] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:40 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:41.495607 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-ea225177-cd7c-4156-96c0-27eb82d67591 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:41.496371 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-ea225177-cd7c-4156-96c0-27eb82d67591 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:41.503138 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ea225177-cd7c-4156-96c0-27eb82d67591 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:41.503615 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ea225177-cd7c-4156-96c0-27eb82d67591 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:41.504042 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ea225177-cd7c-4156-96c0-27eb82d67591 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:41.504720 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ea225177-cd7c-4156-96c0-27eb82d67591 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:41.505164 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ea225177-cd7c-4156-96c0-27eb82d67591 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:41.505580 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ea225177-cd7c-4156-96c0-27eb82d67591 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:41.640312 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ea225177-cd7c-4156-96c0-27eb82d67591 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:41.648833 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ea225177-cd7c-4156-96c0-27eb82d67591 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:41.650588 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ea225177-cd7c-4156-96c0-27eb82d67591 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:41.653285 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-ea225177-cd7c-4156-96c0-27eb82d67591 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1809 microversion: 2.20 time: 0.161653 Oct 26 11:22:41.654418 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 270/529] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:41 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:42.679005 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-07b4aff9-e526-40a2-b3c5-327be3f686f0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:42.679808 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-07b4aff9-e526-40a2-b3c5-327be3f686f0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:42.686392 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-07b4aff9-e526-40a2-b3c5-327be3f686f0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:42.686897 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-07b4aff9-e526-40a2-b3c5-327be3f686f0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:42.687331 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-07b4aff9-e526-40a2-b3c5-327be3f686f0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:42.688015 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-07b4aff9-e526-40a2-b3c5-327be3f686f0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:42.688464 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-07b4aff9-e526-40a2-b3c5-327be3f686f0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:42.688880 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-07b4aff9-e526-40a2-b3c5-327be3f686f0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:42.860635 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-07b4aff9-e526-40a2-b3c5-327be3f686f0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:42.870079 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-07b4aff9-e526-40a2-b3c5-327be3f686f0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:42.871750 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-07b4aff9-e526-40a2-b3c5-327be3f686f0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:42.872928 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-07b4aff9-e526-40a2-b3c5-327be3f686f0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1809 microversion: 2.20 time: 0.197999 Oct 26 11:22:42.873572 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 260/530] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:42 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:43.898516 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-942ec4c9-ca2a-43db-a2d3-cebc0c68ea11 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:43.899163 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-942ec4c9-ca2a-43db-a2d3-cebc0c68ea11 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:43.906034 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-942ec4c9-ca2a-43db-a2d3-cebc0c68ea11 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:43.906517 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-942ec4c9-ca2a-43db-a2d3-cebc0c68ea11 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:43.906982 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-942ec4c9-ca2a-43db-a2d3-cebc0c68ea11 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:43.907667 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-942ec4c9-ca2a-43db-a2d3-cebc0c68ea11 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:43.908188 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-942ec4c9-ca2a-43db-a2d3-cebc0c68ea11 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:43.908618 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-942ec4c9-ca2a-43db-a2d3-cebc0c68ea11 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:44.043330 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-942ec4c9-ca2a-43db-a2d3-cebc0c68ea11 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:44.052393 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-942ec4c9-ca2a-43db-a2d3-cebc0c68ea11 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:44.054133 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-942ec4c9-ca2a-43db-a2d3-cebc0c68ea11 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:44.055343 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-942ec4c9-ca2a-43db-a2d3-cebc0c68ea11 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1809 microversion: 2.20 time: 0.160927 Oct 26 11:22:44.069914 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 271/531] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:43 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:45.084651 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-1a792bd4-0002-452d-bbbf-0e5ac3dc93cb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:45.085227 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-1a792bd4-0002-452d-bbbf-0e5ac3dc93cb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:45.092111 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1a792bd4-0002-452d-bbbf-0e5ac3dc93cb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:45.092595 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1a792bd4-0002-452d-bbbf-0e5ac3dc93cb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:45.093032 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1a792bd4-0002-452d-bbbf-0e5ac3dc93cb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:45.093722 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1a792bd4-0002-452d-bbbf-0e5ac3dc93cb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:45.094173 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1a792bd4-0002-452d-bbbf-0e5ac3dc93cb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:45.094595 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1a792bd4-0002-452d-bbbf-0e5ac3dc93cb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:45.231064 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-1a792bd4-0002-452d-bbbf-0e5ac3dc93cb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:45.240703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-1a792bd4-0002-452d-bbbf-0e5ac3dc93cb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:45.249693 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-1a792bd4-0002-452d-bbbf-0e5ac3dc93cb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:45.249693 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-1a792bd4-0002-452d-bbbf-0e5ac3dc93cb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1809 microversion: 2.20 time: 0.162660 Oct 26 11:22:45.249693 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 261/532] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:45 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:46.269697 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-46c5e380-e006-4b52-afdd-9b94a31ff706 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:46.270726 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-46c5e380-e006-4b52-afdd-9b94a31ff706 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:46.282990 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-46c5e380-e006-4b52-afdd-9b94a31ff706 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:46.283797 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-46c5e380-e006-4b52-afdd-9b94a31ff706 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:46.284358 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-46c5e380-e006-4b52-afdd-9b94a31ff706 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:46.285703 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-46c5e380-e006-4b52-afdd-9b94a31ff706 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:46.286461 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-46c5e380-e006-4b52-afdd-9b94a31ff706 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:46.287201 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-46c5e380-e006-4b52-afdd-9b94a31ff706 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:46.464656 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-46c5e380-e006-4b52-afdd-9b94a31ff706 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:46.473395 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-46c5e380-e006-4b52-afdd-9b94a31ff706 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:46.474964 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-46c5e380-e006-4b52-afdd-9b94a31ff706 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:46.476201 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-46c5e380-e006-4b52-afdd-9b94a31ff706 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1809 microversion: 2.20 time: 0.211385 Oct 26 11:22:46.476841 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 272/533] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:46 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1809 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:47.503210 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-11d5e143-cf6b-4458-93f4-33fe6560e2c6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:47.503797 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-11d5e143-cf6b-4458-93f4-33fe6560e2c6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:47.511135 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-11d5e143-cf6b-4458-93f4-33fe6560e2c6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:47.511631 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-11d5e143-cf6b-4458-93f4-33fe6560e2c6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:47.521735 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-11d5e143-cf6b-4458-93f4-33fe6560e2c6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:47.522517 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-11d5e143-cf6b-4458-93f4-33fe6560e2c6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:47.523040 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-11d5e143-cf6b-4458-93f4-33fe6560e2c6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:47.523485 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-11d5e143-cf6b-4458-93f4-33fe6560e2c6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:47.665315 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-11d5e143-cf6b-4458-93f4-33fe6560e2c6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:47.675390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-11d5e143-cf6b-4458-93f4-33fe6560e2c6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:47.676863 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-11d5e143-cf6b-4458-93f4-33fe6560e2c6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:47.678041 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-11d5e143-cf6b-4458-93f4-33fe6560e2c6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1809 microversion: 2.20 time: 0.178744 Oct 26 11:22:47.678598 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 262/534] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:47 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:48.706512 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-6bd10829-3cf3-4c40-a485-3efb35356b6a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:48.707211 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-6bd10829-3cf3-4c40-a485-3efb35356b6a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:48.729506 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6bd10829-3cf3-4c40-a485-3efb35356b6a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:48.731632 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6bd10829-3cf3-4c40-a485-3efb35356b6a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:48.732268 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6bd10829-3cf3-4c40-a485-3efb35356b6a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:48.732987 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6bd10829-3cf3-4c40-a485-3efb35356b6a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:48.733462 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6bd10829-3cf3-4c40-a485-3efb35356b6a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:48.733882 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6bd10829-3cf3-4c40-a485-3efb35356b6a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:48.886620 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-6bd10829-3cf3-4c40-a485-3efb35356b6a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:48.895359 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-6bd10829-3cf3-4c40-a485-3efb35356b6a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:48.897141 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-6bd10829-3cf3-4c40-a485-3efb35356b6a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:48.898308 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-6bd10829-3cf3-4c40-a485-3efb35356b6a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1809 microversion: 2.20 time: 0.196475 Oct 26 11:22:48.898894 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 273/535] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:48 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1809 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:49.924413 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-0585af45-a0c0-4836-a7ff-7dc9fedbcc18 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:49.925020 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-0585af45-a0c0-4836-a7ff-7dc9fedbcc18 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:49.932473 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0585af45-a0c0-4836-a7ff-7dc9fedbcc18 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:49.932939 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0585af45-a0c0-4836-a7ff-7dc9fedbcc18 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:49.933370 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0585af45-a0c0-4836-a7ff-7dc9fedbcc18 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:49.934061 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0585af45-a0c0-4836-a7ff-7dc9fedbcc18 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:49.934509 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0585af45-a0c0-4836-a7ff-7dc9fedbcc18 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:49.937896 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0585af45-a0c0-4836-a7ff-7dc9fedbcc18 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:50.078688 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-0585af45-a0c0-4836-a7ff-7dc9fedbcc18 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:50.087661 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-0585af45-a0c0-4836-a7ff-7dc9fedbcc18 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:50.089086 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-0585af45-a0c0-4836-a7ff-7dc9fedbcc18 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:50.090241 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-0585af45-a0c0-4836-a7ff-7dc9fedbcc18 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1809 microversion: 2.20 time: 0.169744 Oct 26 11:22:50.090805 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 263/536] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:49 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:51.116111 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-9bf43f39-9a98-469b-ae40-2fce6656ef62 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:51.116712 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-9bf43f39-9a98-469b-ae40-2fce6656ef62 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:51.123371 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9bf43f39-9a98-469b-ae40-2fce6656ef62 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:51.123861 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9bf43f39-9a98-469b-ae40-2fce6656ef62 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:51.124295 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9bf43f39-9a98-469b-ae40-2fce6656ef62 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:51.125038 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9bf43f39-9a98-469b-ae40-2fce6656ef62 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:51.125495 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9bf43f39-9a98-469b-ae40-2fce6656ef62 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:51.125918 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9bf43f39-9a98-469b-ae40-2fce6656ef62 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:51.250353 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-9bf43f39-9a98-469b-ae40-2fce6656ef62 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:51.259411 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-9bf43f39-9a98-469b-ae40-2fce6656ef62 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:51.260872 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-9bf43f39-9a98-469b-ae40-2fce6656ef62 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:51.262021 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-9bf43f39-9a98-469b-ae40-2fce6656ef62 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1809 microversion: 2.20 time: 0.150055 Oct 26 11:22:51.262582 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 274/537] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:51 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:52.287355 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-1d2798a1-89c3-45ce-bd27-7f254e69975f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:52.287963 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-1d2798a1-89c3-45ce-bd27-7f254e69975f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:52.294973 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1d2798a1-89c3-45ce-bd27-7f254e69975f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:52.295467 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1d2798a1-89c3-45ce-bd27-7f254e69975f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:52.295907 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1d2798a1-89c3-45ce-bd27-7f254e69975f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:52.296593 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1d2798a1-89c3-45ce-bd27-7f254e69975f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:52.297070 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1d2798a1-89c3-45ce-bd27-7f254e69975f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:52.297475 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1d2798a1-89c3-45ce-bd27-7f254e69975f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:52.421643 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-1d2798a1-89c3-45ce-bd27-7f254e69975f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:52.430494 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-1d2798a1-89c3-45ce-bd27-7f254e69975f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:52.431980 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-1d2798a1-89c3-45ce-bd27-7f254e69975f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:52.433140 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-1d2798a1-89c3-45ce-bd27-7f254e69975f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1809 microversion: 2.20 time: 0.149752 Oct 26 11:22:52.433701 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 264/538] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:52 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:53.458265 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-a65810c6-bdab-49c4-9e8b-8003c2c57099 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:53.458917 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-a65810c6-bdab-49c4-9e8b-8003c2c57099 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:53.465851 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a65810c6-bdab-49c4-9e8b-8003c2c57099 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:53.466327 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a65810c6-bdab-49c4-9e8b-8003c2c57099 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:53.466754 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a65810c6-bdab-49c4-9e8b-8003c2c57099 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:53.467456 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a65810c6-bdab-49c4-9e8b-8003c2c57099 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:53.467898 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a65810c6-bdab-49c4-9e8b-8003c2c57099 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:53.468312 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a65810c6-bdab-49c4-9e8b-8003c2c57099 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:53.599272 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-a65810c6-bdab-49c4-9e8b-8003c2c57099 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:53.607754 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-a65810c6-bdab-49c4-9e8b-8003c2c57099 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:53.609235 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-a65810c6-bdab-49c4-9e8b-8003c2c57099 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:53.610382 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-a65810c6-bdab-49c4-9e8b-8003c2c57099 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1809 microversion: 2.20 time: 0.156077 Oct 26 11:22:53.610988 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 275/539] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:53 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:54.636772 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-d69bd70d-97f2-4225-ab40-4d7189623794 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:54.637387 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-d69bd70d-97f2-4225-ab40-4d7189623794 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:54.643816 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d69bd70d-97f2-4225-ab40-4d7189623794 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:54.644301 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d69bd70d-97f2-4225-ab40-4d7189623794 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:54.644742 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d69bd70d-97f2-4225-ab40-4d7189623794 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:54.645432 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d69bd70d-97f2-4225-ab40-4d7189623794 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:54.645893 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d69bd70d-97f2-4225-ab40-4d7189623794 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:54.646316 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d69bd70d-97f2-4225-ab40-4d7189623794 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:54.775397 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-d69bd70d-97f2-4225-ab40-4d7189623794 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:54.783941 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-d69bd70d-97f2-4225-ab40-4d7189623794 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:54.785384 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-d69bd70d-97f2-4225-ab40-4d7189623794 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:54.786542 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-d69bd70d-97f2-4225-ab40-4d7189623794 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1809 microversion: 2.20 time: 0.153677 Oct 26 11:22:54.787154 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 265/540] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:54 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:55.812760 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-eccba1d5-552f-49de-89fe-47fab8cd437b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:55.813394 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-eccba1d5-552f-49de-89fe-47fab8cd437b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:55.819916 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-eccba1d5-552f-49de-89fe-47fab8cd437b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:55.820401 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-eccba1d5-552f-49de-89fe-47fab8cd437b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:55.820833 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-eccba1d5-552f-49de-89fe-47fab8cd437b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:55.821518 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-eccba1d5-552f-49de-89fe-47fab8cd437b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:55.821969 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-eccba1d5-552f-49de-89fe-47fab8cd437b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:55.822410 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-eccba1d5-552f-49de-89fe-47fab8cd437b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:55.946942 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-eccba1d5-552f-49de-89fe-47fab8cd437b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:55.955426 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-eccba1d5-552f-49de-89fe-47fab8cd437b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:55.956873 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-eccba1d5-552f-49de-89fe-47fab8cd437b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:55.958612 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-eccba1d5-552f-49de-89fe-47fab8cd437b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1809 microversion: 2.20 time: 0.149167 Oct 26 11:22:55.959190 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 276/541] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:55 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:56.983633 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-1816c0ac-d00e-46ed-96f8-f11a8a9c2214 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:56.984289 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-1816c0ac-d00e-46ed-96f8-f11a8a9c2214 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:56.990347 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1816c0ac-d00e-46ed-96f8-f11a8a9c2214 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:56.990843 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1816c0ac-d00e-46ed-96f8-f11a8a9c2214 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:56.991286 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1816c0ac-d00e-46ed-96f8-f11a8a9c2214 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:56.991966 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1816c0ac-d00e-46ed-96f8-f11a8a9c2214 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:56.992413 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1816c0ac-d00e-46ed-96f8-f11a8a9c2214 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:56.992832 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1816c0ac-d00e-46ed-96f8-f11a8a9c2214 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:57.116665 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-1816c0ac-d00e-46ed-96f8-f11a8a9c2214 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:57.125058 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-1816c0ac-d00e-46ed-96f8-f11a8a9c2214 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:57.126476 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-1816c0ac-d00e-46ed-96f8-f11a8a9c2214 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:57.127676 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-1816c0ac-d00e-46ed-96f8-f11a8a9c2214 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1809 microversion: 2.20 time: 0.147950 Oct 26 11:22:57.128223 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 266/542] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:56 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1809 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:58.153892 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-86d71eb3-10fd-461a-94da-f25c86105306 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:58.154496 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-86d71eb3-10fd-461a-94da-f25c86105306 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:58.161242 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-86d71eb3-10fd-461a-94da-f25c86105306 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:58.161720 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-86d71eb3-10fd-461a-94da-f25c86105306 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:58.162149 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-86d71eb3-10fd-461a-94da-f25c86105306 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:58.162842 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-86d71eb3-10fd-461a-94da-f25c86105306 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:58.163291 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-86d71eb3-10fd-461a-94da-f25c86105306 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:58.163709 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-86d71eb3-10fd-461a-94da-f25c86105306 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:58.287756 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-86d71eb3-10fd-461a-94da-f25c86105306 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:58.296550 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-86d71eb3-10fd-461a-94da-f25c86105306 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:58.298022 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-86d71eb3-10fd-461a-94da-f25c86105306 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:58.299522 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-86d71eb3-10fd-461a-94da-f25c86105306 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1809 microversion: 2.20 time: 0.149507 Oct 26 11:22:58.300086 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 277/543] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:58 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:22:59.324936 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-e05393f3-e35a-40ba-ba90-0a517832e2df tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:22:59.325546 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-e05393f3-e35a-40ba-ba90-0a517832e2df tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:22:59.332537 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e05393f3-e35a-40ba-ba90-0a517832e2df tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:59.333018 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e05393f3-e35a-40ba-ba90-0a517832e2df tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:59.333453 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e05393f3-e35a-40ba-ba90-0a517832e2df tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:59.334137 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e05393f3-e35a-40ba-ba90-0a517832e2df tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:22:59.334590 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e05393f3-e35a-40ba-ba90-0a517832e2df tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:22:59.335045 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e05393f3-e35a-40ba-ba90-0a517832e2df tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:22:59.615323 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-e05393f3-e35a-40ba-ba90-0a517832e2df tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:59.624011 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-e05393f3-e35a-40ba-ba90-0a517832e2df tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:59.625488 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-e05393f3-e35a-40ba-ba90-0a517832e2df tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:22:59.626630 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-e05393f3-e35a-40ba-ba90-0a517832e2df tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1809 microversion: 2.20 time: 0.305587 Oct 26 11:22:59.627224 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 267/544] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:22:59 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1809 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:23:00.653000 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-1df9e681-cfe5-4e40-bac7-edbb565c61d8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:00.653607 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-1df9e681-cfe5-4e40-bac7-edbb565c61d8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:00.659975 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1df9e681-cfe5-4e40-bac7-edbb565c61d8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:00.660457 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1df9e681-cfe5-4e40-bac7-edbb565c61d8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:00.660889 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1df9e681-cfe5-4e40-bac7-edbb565c61d8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:00.661573 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1df9e681-cfe5-4e40-bac7-edbb565c61d8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:00.662085 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1df9e681-cfe5-4e40-bac7-edbb565c61d8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:00.662442 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1df9e681-cfe5-4e40-bac7-edbb565c61d8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:00.792750 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-1df9e681-cfe5-4e40-bac7-edbb565c61d8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:00.802211 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-1df9e681-cfe5-4e40-bac7-edbb565c61d8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:00.803707 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-1df9e681-cfe5-4e40-bac7-edbb565c61d8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:00.804859 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-1df9e681-cfe5-4e40-bac7-edbb565c61d8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1809 microversion: 2.20 time: 0.155845 Oct 26 11:23:00.805421 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 278/545] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:23:00 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:23:01.829784 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-eeb8adce-9055-4eda-b210-b607a5505f6c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:01.830493 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-eeb8adce-9055-4eda-b210-b607a5505f6c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:01.837266 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eeb8adce-9055-4eda-b210-b607a5505f6c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:01.837741 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eeb8adce-9055-4eda-b210-b607a5505f6c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:01.838173 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eeb8adce-9055-4eda-b210-b607a5505f6c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:01.838879 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eeb8adce-9055-4eda-b210-b607a5505f6c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:01.839334 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eeb8adce-9055-4eda-b210-b607a5505f6c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:01.839752 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eeb8adce-9055-4eda-b210-b607a5505f6c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:01.964427 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-eeb8adce-9055-4eda-b210-b607a5505f6c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:01.973057 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-eeb8adce-9055-4eda-b210-b607a5505f6c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:01.974483 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-eeb8adce-9055-4eda-b210-b607a5505f6c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:01.975659 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-eeb8adce-9055-4eda-b210-b607a5505f6c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1809 microversion: 2.20 time: 0.149822 Oct 26 11:23:01.976240 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 268/546] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:23:01 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:23:03.002214 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-4129a371-849e-4790-a8a7-85fb6b5a7898 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:03.002746 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-4129a371-849e-4790-a8a7-85fb6b5a7898 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:03.009341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4129a371-849e-4790-a8a7-85fb6b5a7898 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:03.009816 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4129a371-849e-4790-a8a7-85fb6b5a7898 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:03.010247 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4129a371-849e-4790-a8a7-85fb6b5a7898 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:03.010962 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4129a371-849e-4790-a8a7-85fb6b5a7898 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:03.011410 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4129a371-849e-4790-a8a7-85fb6b5a7898 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:03.011825 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4129a371-849e-4790-a8a7-85fb6b5a7898 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:03.014270 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:23:03.191752 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-4129a371-849e-4790-a8a7-85fb6b5a7898 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:03.200636 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-4129a371-849e-4790-a8a7-85fb6b5a7898 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:03.202164 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-4129a371-849e-4790-a8a7-85fb6b5a7898 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:03.203380 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-4129a371-849e-4790-a8a7-85fb6b5a7898 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1809 microversion: 2.20 time: 0.206067 Oct 26 11:23:03.204041 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 279/547] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:23:02 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1809 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:23:04.229993 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-3cc4a325-c355-463d-9676-11baf3cc7b88 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:04.230599 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-3cc4a325-c355-463d-9676-11baf3cc7b88 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:04.237057 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3cc4a325-c355-463d-9676-11baf3cc7b88 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:04.237580 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3cc4a325-c355-463d-9676-11baf3cc7b88 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:04.238017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3cc4a325-c355-463d-9676-11baf3cc7b88 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:04.238706 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3cc4a325-c355-463d-9676-11baf3cc7b88 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:04.239181 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3cc4a325-c355-463d-9676-11baf3cc7b88 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:04.239602 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3cc4a325-c355-463d-9676-11baf3cc7b88 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:04.365241 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-3cc4a325-c355-463d-9676-11baf3cc7b88 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:04.373714 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-3cc4a325-c355-463d-9676-11baf3cc7b88 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:04.375177 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-3cc4a325-c355-463d-9676-11baf3cc7b88 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:04.376330 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-3cc4a325-c355-463d-9676-11baf3cc7b88 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1809 microversion: 2.20 time: 0.150434 Oct 26 11:23:04.376893 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 269/548] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:23:04 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:23:05.403872 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-abaf27f4-3dee-4b16-9dfc-dedffc5640e5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:05.404476 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-abaf27f4-3dee-4b16-9dfc-dedffc5640e5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:05.411757 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-abaf27f4-3dee-4b16-9dfc-dedffc5640e5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:05.412236 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-abaf27f4-3dee-4b16-9dfc-dedffc5640e5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:05.412664 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-abaf27f4-3dee-4b16-9dfc-dedffc5640e5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:05.413340 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-abaf27f4-3dee-4b16-9dfc-dedffc5640e5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:05.413785 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-abaf27f4-3dee-4b16-9dfc-dedffc5640e5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:05.414219 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-abaf27f4-3dee-4b16-9dfc-dedffc5640e5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:05.544980 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-abaf27f4-3dee-4b16-9dfc-dedffc5640e5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:05.554350 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-abaf27f4-3dee-4b16-9dfc-dedffc5640e5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:05.555851 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-abaf27f4-3dee-4b16-9dfc-dedffc5640e5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:05.557014 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-abaf27f4-3dee-4b16-9dfc-dedffc5640e5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1809 microversion: 2.20 time: 0.157376 Oct 26 11:23:05.557576 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 280/549] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:23:05 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:23:06.114010 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-be14b93c-27cf-4035-a12b-41c76ba9db0f req-8836699c-17e9-47e7-9f59-e7dc9fc10f58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2821a8ff-1cb6-43c5-9968-1c13e293ad1a", "name": "network-vif-plugged", "status": "completed", "tag": "6cd2d732-48e8-4aca-ac57-8f769619a1f1"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:23:06.124010 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-be14b93c-27cf-4035-a12b-41c76ba9db0f req-8836699c-17e9-47e7-9f59-e7dc9fc10f58 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:06.124481 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-be14b93c-27cf-4035-a12b-41c76ba9db0f req-8836699c-17e9-47e7-9f59-e7dc9fc10f58 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:06.125403 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-be14b93c-27cf-4035-a12b-41c76ba9db0f req-8836699c-17e9-47e7-9f59-e7dc9fc10f58 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:06.136163 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-be14b93c-27cf-4035-a12b-41c76ba9db0f req-8836699c-17e9-47e7-9f59-e7dc9fc10f58 service nova] Creating event network-vif-plugged:6cd2d732-48e8-4aca-ac57-8f769619a1f1 for instance 2821a8ff-1cb6-43c5-9968-1c13e293ad1a on hv-cinder-81558 Oct 26 11:23:06.141783 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-be14b93c-27cf-4035-a12b-41c76ba9db0f req-8836699c-17e9-47e7-9f59-e7dc9fc10f58 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031494 Oct 26 11:23:06.142396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 270/550] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:23:06.581603 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-8f9ad90d-2be9-4277-887f-5acdbd650cd4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:06.582212 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-8f9ad90d-2be9-4277-887f-5acdbd650cd4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:06.588457 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8f9ad90d-2be9-4277-887f-5acdbd650cd4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:06.588939 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8f9ad90d-2be9-4277-887f-5acdbd650cd4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:06.589376 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8f9ad90d-2be9-4277-887f-5acdbd650cd4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:06.590063 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8f9ad90d-2be9-4277-887f-5acdbd650cd4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:06.590518 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8f9ad90d-2be9-4277-887f-5acdbd650cd4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:06.590963 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8f9ad90d-2be9-4277-887f-5acdbd650cd4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:06.719269 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-8f9ad90d-2be9-4277-887f-5acdbd650cd4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:06.728144 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-8f9ad90d-2be9-4277-887f-5acdbd650cd4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:06.729622 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-8f9ad90d-2be9-4277-887f-5acdbd650cd4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:06.730764 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-8f9ad90d-2be9-4277-887f-5acdbd650cd4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1809 microversion: 2.20 time: 0.153145 Oct 26 11:23:06.731356 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 281/551] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:23:06 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:23:07.750792 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-6f4c48bb-939b-42eb-a1fc-913fe9d52af8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3133d64-8a09-4094-8900-c06fbadf546f"}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:23:07.753202 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-6f4c48bb-939b-42eb-a1fc-913fe9d52af8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:07.756312 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-91330bf2-03ff-486c-99b4-782c4fc35089 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:07.756991 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-91330bf2-03ff-486c-99b4-782c4fc35089 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:07.759367 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=28 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:23:07.759523 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6f4c48bb-939b-42eb-a1fc-913fe9d52af8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:07.760012 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6f4c48bb-939b-42eb-a1fc-913fe9d52af8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:07.760450 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6f4c48bb-939b-42eb-a1fc-913fe9d52af8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:07.761160 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6f4c48bb-939b-42eb-a1fc-913fe9d52af8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:07.761615 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6f4c48bb-939b-42eb-a1fc-913fe9d52af8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:07.762040 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6f4c48bb-939b-42eb-a1fc-913fe9d52af8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:07.764476 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-91330bf2-03ff-486c-99b4-782c4fc35089 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:07.765631 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-91330bf2-03ff-486c-99b4-782c4fc35089 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:07.766077 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-91330bf2-03ff-486c-99b4-782c4fc35089 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:07.766772 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-91330bf2-03ff-486c-99b4-782c4fc35089 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:07.767255 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-91330bf2-03ff-486c-99b4-782c4fc35089 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:07.767679 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-91330bf2-03ff-486c-99b4-782c4fc35089 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:07.896757 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-91330bf2-03ff-486c-99b4-782c4fc35089 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:07.905212 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-91330bf2-03ff-486c-99b4-782c4fc35089 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:07.906772 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-91330bf2-03ff-486c-99b4-782c4fc35089 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:07.907942 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-91330bf2-03ff-486c-99b4-782c4fc35089 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1809 microversion: 2.20 time: 0.155640 Oct 26 11:23:07.908495 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 282/552] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:23:07 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:23:08.796521 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-6f4c48bb-939b-42eb-a1fc-913fe9d52af8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "POST /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.051063 Oct 26 11:23:08.797134 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 271/553] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Oct 26 11:23:07 2022] POST /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6/os-volume_attachments => generated 194 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:23:09.041916 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-055304aa-f87b-4a9e-9e02-a376a801bf37 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:09.042542 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-055304aa-f87b-4a9e-9e02-a376a801bf37 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:09.048768 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-055304aa-f87b-4a9e-9e02-a376a801bf37 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:09.049259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-055304aa-f87b-4a9e-9e02-a376a801bf37 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:09.049711 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-055304aa-f87b-4a9e-9e02-a376a801bf37 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:09.050399 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-055304aa-f87b-4a9e-9e02-a376a801bf37 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:09.050879 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-055304aa-f87b-4a9e-9e02-a376a801bf37 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:09.051311 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-055304aa-f87b-4a9e-9e02-a376a801bf37 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:09.183622 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-055304aa-f87b-4a9e-9e02-a376a801bf37 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:09.192895 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-055304aa-f87b-4a9e-9e02-a376a801bf37 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:09.194345 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-055304aa-f87b-4a9e-9e02-a376a801bf37 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:09.195554 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-055304aa-f87b-4a9e-9e02-a376a801bf37 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1809 microversion: 2.20 time: 0.266407 Oct 26 11:23:09.196116 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 283/554] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:23:08 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1809 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:23:10.220409 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 11:23:10.220877 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Wed Oct 26 11:23:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a (ip 10.222.0.42) !!! Oct 26 11:23:10.225660 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a33b69c3-34a7-4af5-b67d-4abdf390575a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:10.226393 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-a33b69c3-34a7-4af5-b67d-4abdf390575a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:10.228356 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_api:SELECT=28 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:23:10.234732 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a33b69c3-34a7-4af5-b67d-4abdf390575a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:10.235275 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a33b69c3-34a7-4af5-b67d-4abdf390575a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:10.235714 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a33b69c3-34a7-4af5-b67d-4abdf390575a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:10.236439 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a33b69c3-34a7-4af5-b67d-4abdf390575a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:10.236924 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a33b69c3-34a7-4af5-b67d-4abdf390575a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:10.237351 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a33b69c3-34a7-4af5-b67d-4abdf390575a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:10.377525 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-a33b69c3-34a7-4af5-b67d-4abdf390575a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:10.386145 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-a33b69c3-34a7-4af5-b67d-4abdf390575a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:10.387685 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-a33b69c3-34a7-4af5-b67d-4abdf390575a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:10.389400 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-a33b69c3-34a7-4af5-b67d-4abdf390575a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1809 microversion: 2.20 time: 0.170469 Oct 26 11:23:10.390153 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 272/555] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:23:10 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 11:23:11.415464 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-07fa6188-3e18-46d2-83a7-dbeae75d25f3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:11.416067 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-07fa6188-3e18-46d2-83a7-dbeae75d25f3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:11.422575 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-07fa6188-3e18-46d2-83a7-dbeae75d25f3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:11.423088 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-07fa6188-3e18-46d2-83a7-dbeae75d25f3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:11.423521 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-07fa6188-3e18-46d2-83a7-dbeae75d25f3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:11.424199 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-07fa6188-3e18-46d2-83a7-dbeae75d25f3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:11.424645 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-07fa6188-3e18-46d2-83a7-dbeae75d25f3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:11.425060 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-07fa6188-3e18-46d2-83a7-dbeae75d25f3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:11.553415 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-07fa6188-3e18-46d2-83a7-dbeae75d25f3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:11.562641 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-07fa6188-3e18-46d2-83a7-dbeae75d25f3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:11.564143 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-07fa6188-3e18-46d2-83a7-dbeae75d25f3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:11.565301 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-07fa6188-3e18-46d2-83a7-dbeae75d25f3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1796 microversion: 2.20 time: 0.153707 Oct 26 11:23:11.565902 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 284/556] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:23:11 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1796 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:23:17.388525 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-4b5ffdf7-d101-46f0-9e44-e6aff09d164a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:23:17.390917 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-4b5ffdf7-d101-46f0-9e44-e6aff09d164a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:17.397347 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4b5ffdf7-d101-46f0-9e44-e6aff09d164a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:17.397831 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4b5ffdf7-d101-46f0-9e44-e6aff09d164a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:17.398295 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4b5ffdf7-d101-46f0-9e44-e6aff09d164a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:17.399017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4b5ffdf7-d101-46f0-9e44-e6aff09d164a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:17.399508 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4b5ffdf7-d101-46f0-9e44-e6aff09d164a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:17.407759 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4b5ffdf7-d101-46f0-9e44-e6aff09d164a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:17.407759 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:23:17.424909 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.objects.instance [None req-4b5ffdf7-d101-46f0-9e44-e6aff09d164a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lazy-loading 'flavor' on Instance uuid 975e97a1-fe2c-4f81-88b5-274a052109c6 {{(pid=119305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:23:17.673555 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-4b5ffdf7-d101-46f0-9e44-e6aff09d164a tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "POST /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6/action" status: 200 len: 32 microversion: 2.1 time: 0.289563 Oct 26 11:23:17.674187 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 273/557] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Oct 26 11:23:17 2022] POST /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6/action => generated 32 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 11:23:17.683645 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-cf4d2541-891a-4ca5-9250-66a6da976654 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:17.684253 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-cf4d2541-891a-4ca5-9250-66a6da976654 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:17.691472 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-cf4d2541-891a-4ca5-9250-66a6da976654 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:17.691957 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-cf4d2541-891a-4ca5-9250-66a6da976654 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:17.692398 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-cf4d2541-891a-4ca5-9250-66a6da976654 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:17.693087 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-cf4d2541-891a-4ca5-9250-66a6da976654 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:17.693570 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-cf4d2541-891a-4ca5-9250-66a6da976654 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:17.694167 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-cf4d2541-891a-4ca5-9250-66a6da976654 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:17.831678 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-cf4d2541-891a-4ca5-9250-66a6da976654 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:17.840607 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-cf4d2541-891a-4ca5-9250-66a6da976654 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1735 microversion: 2.1 time: 0.160770 Oct 26 11:23:17.842073 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 285/558] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:23:17 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:23:18.865183 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-de2befcf-e8b8-4833-9acb-08f95d795d82 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:18.865885 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-de2befcf-e8b8-4833-9acb-08f95d795d82 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:18.871953 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-de2befcf-e8b8-4833-9acb-08f95d795d82 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:18.872921 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-de2befcf-e8b8-4833-9acb-08f95d795d82 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:18.873355 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-de2befcf-e8b8-4833-9acb-08f95d795d82 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:18.874036 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-de2befcf-e8b8-4833-9acb-08f95d795d82 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:18.874489 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-de2befcf-e8b8-4833-9acb-08f95d795d82 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:18.874939 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-de2befcf-e8b8-4833-9acb-08f95d795d82 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:19.004320 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-de2befcf-e8b8-4833-9acb-08f95d795d82 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:19.012350 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-de2befcf-e8b8-4833-9acb-08f95d795d82 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1735 microversion: 2.1 time: 0.151923 Oct 26 11:23:19.013540 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 274/559] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:23:18 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:23:20.035440 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-c4043230-4293-4732-8265-bc1915ed7812 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:20.036049 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-c4043230-4293-4732-8265-bc1915ed7812 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:20.042655 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c4043230-4293-4732-8265-bc1915ed7812 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:20.043165 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c4043230-4293-4732-8265-bc1915ed7812 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:20.043635 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c4043230-4293-4732-8265-bc1915ed7812 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:20.044317 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c4043230-4293-4732-8265-bc1915ed7812 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:20.044767 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c4043230-4293-4732-8265-bc1915ed7812 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:20.045185 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c4043230-4293-4732-8265-bc1915ed7812 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:20.167758 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-c4043230-4293-4732-8265-bc1915ed7812 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:20.176382 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-c4043230-4293-4732-8265-bc1915ed7812 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1735 microversion: 2.1 time: 0.144758 Oct 26 11:23:20.176950 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 286/560] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:23:20 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:23:21.200161 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-354d4aec-e93c-4520-a25b-0ec02b76dbdb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:21.200801 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-354d4aec-e93c-4520-a25b-0ec02b76dbdb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:21.207469 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-354d4aec-e93c-4520-a25b-0ec02b76dbdb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:21.207952 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-354d4aec-e93c-4520-a25b-0ec02b76dbdb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:21.208402 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-354d4aec-e93c-4520-a25b-0ec02b76dbdb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:21.209072 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-354d4aec-e93c-4520-a25b-0ec02b76dbdb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:21.209526 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-354d4aec-e93c-4520-a25b-0ec02b76dbdb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:21.209951 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-354d4aec-e93c-4520-a25b-0ec02b76dbdb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:21.335555 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-354d4aec-e93c-4520-a25b-0ec02b76dbdb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:21.343976 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-354d4aec-e93c-4520-a25b-0ec02b76dbdb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1735 microversion: 2.1 time: 0.147709 Oct 26 11:23:21.344543 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 275/561] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:23:21 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:23:22.367754 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-549c7bd2-0bbe-4a55-942b-402ca048d2fb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:22.368388 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-549c7bd2-0bbe-4a55-942b-402ca048d2fb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:22.374725 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-549c7bd2-0bbe-4a55-942b-402ca048d2fb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:22.375249 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-549c7bd2-0bbe-4a55-942b-402ca048d2fb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:22.375688 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-549c7bd2-0bbe-4a55-942b-402ca048d2fb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:22.376377 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-549c7bd2-0bbe-4a55-942b-402ca048d2fb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:22.376830 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-549c7bd2-0bbe-4a55-942b-402ca048d2fb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:22.377259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-549c7bd2-0bbe-4a55-942b-402ca048d2fb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:22.506319 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-549c7bd2-0bbe-4a55-942b-402ca048d2fb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:22.515258 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-549c7bd2-0bbe-4a55-942b-402ca048d2fb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1735 microversion: 2.1 time: 0.151356 Oct 26 11:23:22.515832 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 287/562] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:23:22 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:23:23.539564 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-139e3b51-e998-407f-abc9-ee5612c3214b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:23.540175 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-139e3b51-e998-407f-abc9-ee5612c3214b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:23.547297 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-139e3b51-e998-407f-abc9-ee5612c3214b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:23.547783 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-139e3b51-e998-407f-abc9-ee5612c3214b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:23.548260 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-139e3b51-e998-407f-abc9-ee5612c3214b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:23.548948 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-139e3b51-e998-407f-abc9-ee5612c3214b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:23.549402 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-139e3b51-e998-407f-abc9-ee5612c3214b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:23.549826 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-139e3b51-e998-407f-abc9-ee5612c3214b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:23.675592 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-139e3b51-e998-407f-abc9-ee5612c3214b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:23.683885 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-139e3b51-e998-407f-abc9-ee5612c3214b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1735 microversion: 2.1 time: 0.148425 Oct 26 11:23:23.688340 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 276/563] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:23:23 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:23:24.708018 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-dd0db24d-9859-4c15-a27e-7080762b92da tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:24.708630 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-dd0db24d-9859-4c15-a27e-7080762b92da tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:24.715089 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dd0db24d-9859-4c15-a27e-7080762b92da tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:24.715573 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dd0db24d-9859-4c15-a27e-7080762b92da tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:24.716011 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dd0db24d-9859-4c15-a27e-7080762b92da tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:24.716696 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dd0db24d-9859-4c15-a27e-7080762b92da tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:24.717151 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dd0db24d-9859-4c15-a27e-7080762b92da tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:24.717574 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dd0db24d-9859-4c15-a27e-7080762b92da tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:24.842798 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-dd0db24d-9859-4c15-a27e-7080762b92da tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:24.851099 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-dd0db24d-9859-4c15-a27e-7080762b92da tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1735 microversion: 2.1 time: 0.146918 Oct 26 11:23:24.851670 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 288/564] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:23:24 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:23:25.875417 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-0f571192-743b-4271-9cc9-1255690e7841 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:25.876020 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-0f571192-743b-4271-9cc9-1255690e7841 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:25.882329 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0f571192-743b-4271-9cc9-1255690e7841 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:25.882805 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0f571192-743b-4271-9cc9-1255690e7841 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:25.883264 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0f571192-743b-4271-9cc9-1255690e7841 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:25.883938 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0f571192-743b-4271-9cc9-1255690e7841 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:25.884383 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0f571192-743b-4271-9cc9-1255690e7841 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:25.884800 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0f571192-743b-4271-9cc9-1255690e7841 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:26.013517 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-0f571192-743b-4271-9cc9-1255690e7841 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:26.021488 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-0f571192-743b-4271-9cc9-1255690e7841 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1735 microversion: 2.1 time: 0.149904 Oct 26 11:23:26.022050 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 277/565] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:23:25 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:23:27.044883 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-bcf6b8ed-82c8-4677-8d3d-9c46609d687f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:27.045435 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-bcf6b8ed-82c8-4677-8d3d-9c46609d687f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:27.051774 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bcf6b8ed-82c8-4677-8d3d-9c46609d687f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:27.052253 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bcf6b8ed-82c8-4677-8d3d-9c46609d687f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:27.052700 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bcf6b8ed-82c8-4677-8d3d-9c46609d687f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:27.053362 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bcf6b8ed-82c8-4677-8d3d-9c46609d687f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:27.053809 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bcf6b8ed-82c8-4677-8d3d-9c46609d687f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:27.054220 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bcf6b8ed-82c8-4677-8d3d-9c46609d687f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:27.179362 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-bcf6b8ed-82c8-4677-8d3d-9c46609d687f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:27.187862 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-bcf6b8ed-82c8-4677-8d3d-9c46609d687f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1735 microversion: 2.1 time: 0.146935 Oct 26 11:23:27.188425 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 289/566] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:23:27 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:23:28.210685 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-e954908d-cf07-4aad-9160-09b6c840e59f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:28.211338 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-e954908d-cf07-4aad-9160-09b6c840e59f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:28.218392 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e954908d-cf07-4aad-9160-09b6c840e59f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:28.218901 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e954908d-cf07-4aad-9160-09b6c840e59f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:28.219341 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e954908d-cf07-4aad-9160-09b6c840e59f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:28.220026 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e954908d-cf07-4aad-9160-09b6c840e59f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:28.220478 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e954908d-cf07-4aad-9160-09b6c840e59f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:28.220899 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e954908d-cf07-4aad-9160-09b6c840e59f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:28.346170 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-e954908d-cf07-4aad-9160-09b6c840e59f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:28.354435 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-e954908d-cf07-4aad-9160-09b6c840e59f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1735 microversion: 2.1 time: 0.147515 Oct 26 11:23:28.355025 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 278/567] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:23:28 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:23:29.377422 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-d3025c46-f6a9-4040-9620-3e0adddd3e83 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:29.378074 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-d3025c46-f6a9-4040-9620-3e0adddd3e83 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:29.384441 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d3025c46-f6a9-4040-9620-3e0adddd3e83 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:29.384920 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d3025c46-f6a9-4040-9620-3e0adddd3e83 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:29.385350 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d3025c46-f6a9-4040-9620-3e0adddd3e83 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:29.386029 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d3025c46-f6a9-4040-9620-3e0adddd3e83 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:29.386473 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d3025c46-f6a9-4040-9620-3e0adddd3e83 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:29.386917 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d3025c46-f6a9-4040-9620-3e0adddd3e83 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:29.515285 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-d3025c46-f6a9-4040-9620-3e0adddd3e83 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:29.523407 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-d3025c46-f6a9-4040-9620-3e0adddd3e83 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1735 microversion: 2.1 time: 0.149848 Oct 26 11:23:29.528501 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 290/568] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:23:29 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:23:30.547839 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-0daabfc9-2697-4f21-8ba7-ae08d9d750eb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:30.548619 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-0daabfc9-2697-4f21-8ba7-ae08d9d750eb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:30.555470 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0daabfc9-2697-4f21-8ba7-ae08d9d750eb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:30.555950 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0daabfc9-2697-4f21-8ba7-ae08d9d750eb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:30.556396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0daabfc9-2697-4f21-8ba7-ae08d9d750eb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:30.557899 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0daabfc9-2697-4f21-8ba7-ae08d9d750eb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:30.558356 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0daabfc9-2697-4f21-8ba7-ae08d9d750eb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:30.558777 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0daabfc9-2697-4f21-8ba7-ae08d9d750eb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:30.737651 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-0daabfc9-2697-4f21-8ba7-ae08d9d750eb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:30.749758 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-0daabfc9-2697-4f21-8ba7-ae08d9d750eb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1735 microversion: 2.1 time: 0.206182 Oct 26 11:23:30.750340 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 279/569] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:23:30 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1735 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:23:31.773524 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-da8ae6e6-a70d-4ed0-ae56-bbb3d5f9def8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:31.774133 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-da8ae6e6-a70d-4ed0-ae56-bbb3d5f9def8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:31.780446 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-da8ae6e6-a70d-4ed0-ae56-bbb3d5f9def8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:31.780924 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-da8ae6e6-a70d-4ed0-ae56-bbb3d5f9def8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:31.781353 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-da8ae6e6-a70d-4ed0-ae56-bbb3d5f9def8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:31.782041 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-da8ae6e6-a70d-4ed0-ae56-bbb3d5f9def8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:31.782488 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-da8ae6e6-a70d-4ed0-ae56-bbb3d5f9def8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:31.782931 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-da8ae6e6-a70d-4ed0-ae56-bbb3d5f9def8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:31.908048 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-da8ae6e6-a70d-4ed0-ae56-bbb3d5f9def8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:31.916903 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-da8ae6e6-a70d-4ed0-ae56-bbb3d5f9def8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1735 microversion: 2.1 time: 0.146847 Oct 26 11:23:31.917472 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 291/570] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:23:31 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:23:32.942270 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-1708df1d-1ab2-4b39-a95a-d1aa93298e66 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:32.942907 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-1708df1d-1ab2-4b39-a95a-d1aa93298e66 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:32.949931 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1708df1d-1ab2-4b39-a95a-d1aa93298e66 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:32.950410 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1708df1d-1ab2-4b39-a95a-d1aa93298e66 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:32.950854 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1708df1d-1ab2-4b39-a95a-d1aa93298e66 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:32.951539 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1708df1d-1ab2-4b39-a95a-d1aa93298e66 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:32.951988 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1708df1d-1ab2-4b39-a95a-d1aa93298e66 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:32.952408 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1708df1d-1ab2-4b39-a95a-d1aa93298e66 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:33.081890 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-1708df1d-1ab2-4b39-a95a-d1aa93298e66 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:33.090068 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-1708df1d-1ab2-4b39-a95a-d1aa93298e66 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1715 microversion: 2.1 time: 0.151833 Oct 26 11:23:33.090631 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 280/571] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:23:32 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1715 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:23:33.155439 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e0a15252-cc93-4668-a7fc-426a5b958771 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:33.155946 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-e0a15252-cc93-4668-a7fc-426a5b958771 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:33.162430 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e0a15252-cc93-4668-a7fc-426a5b958771 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:33.162962 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e0a15252-cc93-4668-a7fc-426a5b958771 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:33.163398 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e0a15252-cc93-4668-a7fc-426a5b958771 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:33.164087 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e0a15252-cc93-4668-a7fc-426a5b958771 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:33.164540 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e0a15252-cc93-4668-a7fc-426a5b958771 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:33.164960 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e0a15252-cc93-4668-a7fc-426a5b958771 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:33.290069 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.wsgi [None req-e0a15252-cc93-4668-a7fc-426a5b958771 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] HTTP exception thrown: Cannot 'detach_volume' instance 975e97a1-fe2c-4f81-88b5-274a052109c6 while it is in vm_state rescued Oct 26 11:23:33.291786 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e0a15252-cc93-4668-a7fc-426a5b958771 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Request method failure captured: Oct 26 11:23:33.291786 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: request: DELETE /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6/os-volume_attachments/b3133d64-8a09-4094-8900-c06fbadf546f HTTP/1.1 Oct 26 11:23:33.291786 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept: application/json Oct 26 11:23:33.291786 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept-Encoding: identity Oct 26 11:23:33.291786 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Connection: close Oct 26 11:23:33.291786 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Length: 0 Oct 26 11:23:33.291786 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Type: application/json Oct 26 11:23:33.291786 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Host: 10.222.0.42 Oct 26 11:23:33.291786 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Openstack-System-Scope: None Oct 26 11:23:33.291786 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: User-Agent: python-urllib3/1.26.12 Oct 26 11:23:33.291786 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Auth-Token: gAAAAABjWRd40WLM7XlbrGPbRw18F96uIOfpp8NDITvfojHp3EyOTvndi67r1Fha0TOXdoTqce01i5ZheMOxUzOr8ymSH94zV3s0kkFIS65f_eWJ6teUfzHgs74JxT0RZTqA8nleV0r2Q_qChfss6AyzzJ4qh4wmZHWc0a-DEdFXeuuJ2u8f3Og Oct 26 11:23:33.291786 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Id: None Oct 26 11:23:33.291786 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Name: None Oct 26 11:23:33.291786 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Identity-Status: Confirmed Oct 26 11:23:33.291786 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Is-Admin-Project: True Oct 26 11:23:33.291786 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Id: default Oct 26 11:23:33.291786 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Name: Default Oct 26 11:23:33.291786 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Id: 9d9d2ce62fb74bdb8de53bc06b1a999d Oct 26 11:23:33.291786 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1384722553 Oct 26 11:23:33.291786 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Role: member,reader Oct 26 11:23:33.291786 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Roles: member,reader Oct 26 11:23:33.293341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d9d2ce62fb74bdb8de53bc06b1a999d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d9d2ce62fb74bdb8de53bc06b1a999d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d9d2ce62fb74bdb8de53bc06b1a999d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d9d2ce62fb74bdb8de53bc06b1a999d"}]}] Oct 26 11:23:33.293341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1384722553 Oct 26 11:23:33.293341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Id: 9d9d2ce62fb74bdb8de53bc06b1a999d Oct 26 11:23:33.293341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1384722553 Oct 26 11:23:33.293341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User: tempest-ServerRescueNegativeTestJSON-1384722553-project Oct 26 11:23:33.293341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Id: default Oct 26 11:23:33.293341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Name: Default Oct 26 11:23:33.293341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Id: ff0c5f8521534fc1a0a9c5ea28fbaac1 Oct 26 11:23:33.293341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1384722553-project Oct 26 11:23:33.293341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: method: > Oct 26 11:23:33.293341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: exception: Cannot 'detach_volume' instance 975e97a1-fe2c-4f81-88b5-274a052109c6 while it is in vm_state rescued Oct 26 11:23:33.294080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: action_args: {'server_id': '975e97a1-fe2c-4f81-88b5-274a052109c6', 'id': 'b3133d64-8a09-4094-8900-c06fbadf546f'} Oct 26 11:23:33.294080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:23:33.294080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:23:33.294080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 26 11:23:33.294080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 26 11:23:33.294080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 11:23:33.294080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 11:23:33.294080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 26 11:23:33.294080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 26 11:23:33.294080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 975e97a1-fe2c-4f81-88b5-274a052109c6 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 26 11:23:33.294080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:23:33.294080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:23:33.294080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:23:33.294080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:23:33.294080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:23:33.294080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:23:33.294080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:23:33.294080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:23:33.294080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:23:33.294080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:23:33.295452 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 26 11:23:33.295452 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 26 11:23:33.295452 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 26 11:23:33.295452 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 26 11:23:33.295452 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 975e97a1-fe2c-4f81-88b5-274a052109c6 while it is in vm_state rescued Oct 26 11:23:33.295452 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:23:33.295452 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:23:33.295452 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:23:33.295452 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:23:33.295452 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:23:33.295452 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:23:33.295452 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:23:33.295452 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:23:33.295452 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 975e97a1-fe2c-4f81-88b5-274a052109c6 while it is in vm_state rescued Oct 26 11:23:33.295452 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:23:33.295452 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e0a15252-cc93-4668-a7fc-426a5b958771 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Returning 409 to user: Cannot 'detach_volume' instance 975e97a1-fe2c-4f81-88b5-274a052109c6 while it is in vm_state rescued {{(pid=119306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:23:33.296408 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-e0a15252-cc93-4668-a7fc-426a5b958771 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "DELETE /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6/os-volume_attachments/b3133d64-8a09-4094-8900-c06fbadf546f" status: 409 len: 152 microversion: 2.1 time: 0.141707 Oct 26 11:23:33.296408 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 292/572] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Oct 26 11:23:33 2022] DELETE /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6/os-volume_attachments/b3133d64-8a09-4094-8900-c06fbadf546f => generated 152 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 26 11:23:33.302200 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-35c95581-4e26-42be-9d4c-89f74522b557 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:23:33.302732 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-35c95581-4e26-42be-9d4c-89f74522b557 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:33.309030 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-35c95581-4e26-42be-9d4c-89f74522b557 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:33.309511 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-35c95581-4e26-42be-9d4c-89f74522b557 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:33.309941 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-35c95581-4e26-42be-9d4c-89f74522b557 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:33.310620 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-35c95581-4e26-42be-9d4c-89f74522b557 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:33.311087 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-35c95581-4e26-42be-9d4c-89f74522b557 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:33.311504 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-35c95581-4e26-42be-9d4c-89f74522b557 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:33.496675 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-35c95581-4e26-42be-9d4c-89f74522b557 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "POST /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6/action" status: 202 len: 0 microversion: 2.1 time: 0.198324 Oct 26 11:23:33.497454 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 281/573] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Oct 26 11:23:33 2022] POST /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 11:23:33.505513 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-7131d64b-5cab-4587-be15-ec19dd352ebf tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:33.506120 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-7131d64b-5cab-4587-be15-ec19dd352ebf tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:33.513379 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7131d64b-5cab-4587-be15-ec19dd352ebf tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:33.513868 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7131d64b-5cab-4587-be15-ec19dd352ebf tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:33.514303 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7131d64b-5cab-4587-be15-ec19dd352ebf tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:33.515049 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7131d64b-5cab-4587-be15-ec19dd352ebf tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:33.515508 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7131d64b-5cab-4587-be15-ec19dd352ebf tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:33.515929 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7131d64b-5cab-4587-be15-ec19dd352ebf tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:33.646005 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-7131d64b-5cab-4587-be15-ec19dd352ebf tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:33.654879 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-7131d64b-5cab-4587-be15-ec19dd352ebf tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1723 microversion: 2.1 time: 0.153208 Oct 26 11:23:33.655576 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 293/574] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:23:33 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:23:34.679800 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-4677e846-b3f6-4780-bf3d-1a7dd386a5bc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:34.680492 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-4677e846-b3f6-4780-bf3d-1a7dd386a5bc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:34.686557 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4677e846-b3f6-4780-bf3d-1a7dd386a5bc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:34.692649 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4677e846-b3f6-4780-bf3d-1a7dd386a5bc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:34.692649 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4677e846-b3f6-4780-bf3d-1a7dd386a5bc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:34.692649 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4677e846-b3f6-4780-bf3d-1a7dd386a5bc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:34.692649 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4677e846-b3f6-4780-bf3d-1a7dd386a5bc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:34.693061 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4677e846-b3f6-4780-bf3d-1a7dd386a5bc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:34.819685 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-4677e846-b3f6-4780-bf3d-1a7dd386a5bc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:34.827739 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-4677e846-b3f6-4780-bf3d-1a7dd386a5bc tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1723 microversion: 2.1 time: 0.152729 Oct 26 11:23:34.828293 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 282/575] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:23:34 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:23:35.851329 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-62ae618b-e49f-48a6-9467-206df827cbc1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:35.852870 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-62ae618b-e49f-48a6-9467-206df827cbc1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:35.858101 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-62ae618b-e49f-48a6-9467-206df827cbc1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:35.858630 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-62ae618b-e49f-48a6-9467-206df827cbc1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:35.859083 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-62ae618b-e49f-48a6-9467-206df827cbc1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:35.859762 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-62ae618b-e49f-48a6-9467-206df827cbc1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:35.860207 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-62ae618b-e49f-48a6-9467-206df827cbc1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:35.860624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-62ae618b-e49f-48a6-9467-206df827cbc1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:35.864455 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=90 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:23:35.985176 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-62ae618b-e49f-48a6-9467-206df827cbc1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:35.993650 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-62ae618b-e49f-48a6-9467-206df827cbc1 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1723 microversion: 2.1 time: 0.145928 Oct 26 11:23:35.994210 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 294/576] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:23:35 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:23:37.017486 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-ffd6b4f6-f627-453f-b03f-2e0e6866260b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:37.018019 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-ffd6b4f6-f627-453f-b03f-2e0e6866260b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:37.024525 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ffd6b4f6-f627-453f-b03f-2e0e6866260b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:37.025006 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ffd6b4f6-f627-453f-b03f-2e0e6866260b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:37.025450 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ffd6b4f6-f627-453f-b03f-2e0e6866260b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:37.026130 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ffd6b4f6-f627-453f-b03f-2e0e6866260b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:37.026578 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ffd6b4f6-f627-453f-b03f-2e0e6866260b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:37.027027 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ffd6b4f6-f627-453f-b03f-2e0e6866260b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:37.155389 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-ffd6b4f6-f627-453f-b03f-2e0e6866260b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:37.163896 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-ffd6b4f6-f627-453f-b03f-2e0e6866260b tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1723 microversion: 2.1 time: 0.150458 Oct 26 11:23:37.164968 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 283/577] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:23:37 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:23:38.187578 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-6e18e783-1d41-41a3-a9e1-70dd18bed0fa tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:38.188181 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-6e18e783-1d41-41a3-a9e1-70dd18bed0fa tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:38.190455 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=26 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:23:38.195063 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6e18e783-1d41-41a3-a9e1-70dd18bed0fa tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:38.196033 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6e18e783-1d41-41a3-a9e1-70dd18bed0fa tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:38.196462 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6e18e783-1d41-41a3-a9e1-70dd18bed0fa tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:38.197137 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6e18e783-1d41-41a3-a9e1-70dd18bed0fa tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:38.197580 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6e18e783-1d41-41a3-a9e1-70dd18bed0fa tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:38.197992 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6e18e783-1d41-41a3-a9e1-70dd18bed0fa tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:38.324489 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-6e18e783-1d41-41a3-a9e1-70dd18bed0fa tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:38.332761 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-6e18e783-1d41-41a3-a9e1-70dd18bed0fa tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1729 microversion: 2.1 time: 0.149040 Oct 26 11:23:38.333372 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 295/578] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:23:38 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:23:38.355179 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-4574db2a-e186-49fd-b942-dfa10b1bedfa tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:38.355680 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-4574db2a-e186-49fd-b942-dfa10b1bedfa tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:38.362067 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4574db2a-e186-49fd-b942-dfa10b1bedfa tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:38.362546 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4574db2a-e186-49fd-b942-dfa10b1bedfa tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:38.363015 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4574db2a-e186-49fd-b942-dfa10b1bedfa tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:38.363695 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4574db2a-e186-49fd-b942-dfa10b1bedfa tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:38.364142 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4574db2a-e186-49fd-b942-dfa10b1bedfa tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:38.364560 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4574db2a-e186-49fd-b942-dfa10b1bedfa tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:38.442383 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-4574db2a-e186-49fd-b942-dfa10b1bedfa tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091023 Oct 26 11:23:38.443142 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 284/579] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Oct 26 11:23:38 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:23:39.610219 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-8ae04fb8-5354-4b17-bd6b-56e2a392f158 req-ad3d0fdc-553c-47d3-a3ac-c48f19573d61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "975e97a1-fe2c-4f81-88b5-274a052109c6", "tag": "aa03144d-b19b-4e5d-8027-1ca2393de35d"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:23:39.620277 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-8ae04fb8-5354-4b17-bd6b-56e2a392f158 req-ad3d0fdc-553c-47d3-a3ac-c48f19573d61 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:39.620757 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-8ae04fb8-5354-4b17-bd6b-56e2a392f158 req-ad3d0fdc-553c-47d3-a3ac-c48f19573d61 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:39.621192 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-8ae04fb8-5354-4b17-bd6b-56e2a392f158 req-ad3d0fdc-553c-47d3-a3ac-c48f19573d61 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:39.631851 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-8ae04fb8-5354-4b17-bd6b-56e2a392f158 req-ad3d0fdc-553c-47d3-a3ac-c48f19573d61 service nova] Creating event network-changed:aa03144d-b19b-4e5d-8027-1ca2393de35d for instance 975e97a1-fe2c-4f81-88b5-274a052109c6 on hv-cinder-81558 Oct 26 11:23:39.636843 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-8ae04fb8-5354-4b17-bd6b-56e2a392f158 req-ad3d0fdc-553c-47d3-a3ac-c48f19573d61 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086344 Oct 26 11:23:39.637464 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 296/580] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:23:41.651718 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-ed243131-4c61-4a9e-ad2d-7acc2d4e9b92 req-00b979ef-1aa8-44c4-b3f1-5d2deb571d43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "975e97a1-fe2c-4f81-88b5-274a052109c6", "tag": "aa03144d-b19b-4e5d-8027-1ca2393de35d"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:23:41.656564 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_api:SELECT=26 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:23:41.661823 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-ed243131-4c61-4a9e-ad2d-7acc2d4e9b92 req-00b979ef-1aa8-44c4-b3f1-5d2deb571d43 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:41.662292 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-ed243131-4c61-4a9e-ad2d-7acc2d4e9b92 req-00b979ef-1aa8-44c4-b3f1-5d2deb571d43 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:41.662713 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-ed243131-4c61-4a9e-ad2d-7acc2d4e9b92 req-00b979ef-1aa8-44c4-b3f1-5d2deb571d43 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:41.673930 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-ed243131-4c61-4a9e-ad2d-7acc2d4e9b92 req-00b979ef-1aa8-44c4-b3f1-5d2deb571d43 service nova] Creating event network-changed:aa03144d-b19b-4e5d-8027-1ca2393de35d for instance 975e97a1-fe2c-4f81-88b5-274a052109c6 on hv-cinder-81558 Oct 26 11:23:41.679781 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-ed243131-4c61-4a9e-ad2d-7acc2d4e9b92 req-00b979ef-1aa8-44c4-b3f1-5d2deb571d43 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031201 Oct 26 11:23:41.680173 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 285/581] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:23:47.304864 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-7ceecf10-c856-4360-b83a-c361b1c89c41 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:47.305447 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-7ceecf10-c856-4360-b83a-c361b1c89c41 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: a45dcfbe-3437-4feb-a827-dcfc141a24f9] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:47.311473 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7ceecf10-c856-4360-b83a-c361b1c89c41 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:47.311951 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7ceecf10-c856-4360-b83a-c361b1c89c41 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:47.312384 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7ceecf10-c856-4360-b83a-c361b1c89c41 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:47.313069 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7ceecf10-c856-4360-b83a-c361b1c89c41 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:47.313519 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7ceecf10-c856-4360-b83a-c361b1c89c41 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:47.313940 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7ceecf10-c856-4360-b83a-c361b1c89c41 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:47.337240 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-7ceecf10-c856-4360-b83a-c361b1c89c41 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9/ips" status: 200 len: 149 microversion: 2.1 time: 0.137158 Oct 26 11:23:47.337785 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 297/582] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Oct 26 11:23:47 2022] GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9/ips => generated 149 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:23:47.352209 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-df251953-28ce-4e46-8eb1-b55c2838be31 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b3e9ee3-bf23-476f-b058-a1a30b798b8b"}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:23:47.354578 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-df251953-28ce-4e46-8eb1-b55c2838be31 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: a45dcfbe-3437-4feb-a827-dcfc141a24f9] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:47.361013 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-df251953-28ce-4e46-8eb1-b55c2838be31 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:47.361491 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-df251953-28ce-4e46-8eb1-b55c2838be31 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:47.361918 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-df251953-28ce-4e46-8eb1-b55c2838be31 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:47.362592 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-df251953-28ce-4e46-8eb1-b55c2838be31 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:47.363065 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-df251953-28ce-4e46-8eb1-b55c2838be31 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:47.363483 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-df251953-28ce-4e46-8eb1-b55c2838be31 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:47.442826 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.wsgi [None req-df251953-28ce-4e46-8eb1-b55c2838be31 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] HTTP exception thrown: Invalid volume: volume 3b3e9ee3-bf23-476f-b058-a1a30b798b8b is already attached to instances: 5c038aa8-5351-4f13-8fc5-32674a0f6dce Oct 26 11:23:47.445196 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-df251953-28ce-4e46-8eb1-b55c2838be31 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Request method failure captured: Oct 26 11:23:47.445196 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: request: POST /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9/os-volume_attachments HTTP/1.1 Oct 26 11:23:47.445196 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept: application/json Oct 26 11:23:47.445196 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept-Encoding: identity Oct 26 11:23:47.445196 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Connection: close Oct 26 11:23:47.445196 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Length: 74 Oct 26 11:23:47.445196 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Type: application/json Oct 26 11:23:47.445196 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Host: 10.222.0.42 Oct 26 11:23:47.445196 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Openstack-System-Scope: None Oct 26 11:23:47.445196 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: User-Agent: python-urllib3/1.26.12 Oct 26 11:23:47.445196 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Auth-Token: gAAAAABjWRd0c_l4dNmZmsslzgq0Y1mw7cHb2LyArYA_xomuSGUALJJhwUTg-8wegSnjp12OMWl50wz-0CzDaxBHziSvRsAIfgm9nG8oyGTTyhi4gK_QpH-0WiSM5GZmswPu8j2lHFCwK-c7q-bBx1gr_dj9FZxEy_m8cDa2tIsj3jWPztpcm3k Oct 26 11:23:47.445196 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Id: None Oct 26 11:23:47.445196 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Name: None Oct 26 11:23:47.445196 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Identity-Status: Confirmed Oct 26 11:23:47.445196 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Is-Admin-Project: True Oct 26 11:23:47.445196 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Id: default Oct 26 11:23:47.445196 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Name: Default Oct 26 11:23:47.445196 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Id: 724121c2144843b7adc7e17312613c9d Oct 26 11:23:47.445196 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:23:47.445196 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Role: member,reader Oct 26 11:23:47.445196 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Roles: member,reader Oct 26 11:23:47.446752 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_724121c2144843b7adc7e17312613c9d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724121c2144843b7adc7e17312613c9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/724121c2144843b7adc7e17312613c9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724121c2144843b7adc7e17312613c9d"}]}] Oct 26 11:23:47.446752 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:23:47.446752 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Id: 724121c2144843b7adc7e17312613c9d Oct 26 11:23:47.446752 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:23:47.446752 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User: tempest-AttachVolumeNegativeTest-1560590927-project Oct 26 11:23:47.446752 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Id: default Oct 26 11:23:47.446752 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Name: Default Oct 26 11:23:47.446752 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Id: e031dd9da25146eebb8813dc8bad8b85 Oct 26 11:23:47.446752 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Name: tempest-AttachVolumeNegativeTest-1560590927-project Oct 26 11:23:47.446752 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Oct 26 11:23:47.446752 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {"volumeAttachment": {"volumeId": "3b3e9ee3-bf23-476f-b058-a1a30b798b8b"}} Oct 26 11:23:47.446752 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: method: > Oct 26 11:23:47.447901 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: exception: Invalid volume: volume 3b3e9ee3-bf23-476f-b058-a1a30b798b8b is already attached to instances: 5c038aa8-5351-4f13-8fc5-32674a0f6dce Oct 26 11:23:47.447901 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: action_args: {'server_id': 'a45dcfbe-3437-4feb-a827-dcfc141a24f9', 'body': {'volumeAttachment': {'volumeId': '3b3e9ee3-bf23-476f-b058-a1a30b798b8b'}}} Oct 26 11:23:47.447901 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:23:47.447901 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:23:47.447901 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 26 11:23:47.447901 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 26 11:23:47.447901 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 11:23:47.447901 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 11:23:47.447901 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 26 11:23:47.447901 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 11:23:47.447901 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 26 11:23:47.447901 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 26 11:23:47.447901 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 26 11:23:47.447901 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 26 11:23:47.447901 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3b3e9ee3-bf23-476f-b058-a1a30b798b8b is already attached to instances: 5c038aa8-5351-4f13-8fc5-32674a0f6dce Oct 26 11:23:47.447901 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:23:47.447901 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:23:47.447901 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:23:47.447901 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:23:47.449346 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:23:47.449346 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:23:47.449346 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:23:47.449346 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:23:47.449346 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:23:47.449346 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:23:47.449346 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 11:23:47.449346 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 11:23:47.449346 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 11:23:47.449346 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 11:23:47.449346 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 11:23:47.449346 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 11:23:47.449346 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 26 11:23:47.449346 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 26 11:23:47.449346 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3b3e9ee3-bf23-476f-b058-a1a30b798b8b is already attached to instances: 5c038aa8-5351-4f13-8fc5-32674a0f6dce Oct 26 11:23:47.449346 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:23:47.449346 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:23:47.449346 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:23:47.449346 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:23:47.449346 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:23:47.450971 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:23:47.450971 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:23:47.450971 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:23:47.450971 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3b3e9ee3-bf23-476f-b058-a1a30b798b8b is already attached to instances: 5c038aa8-5351-4f13-8fc5-32674a0f6dce Oct 26 11:23:47.450971 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:23:47.450971 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-df251953-28ce-4e46-8eb1-b55c2838be31 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Returning 400 to user: Invalid volume: volume 3b3e9ee3-bf23-476f-b058-a1a30b798b8b is already attached to instances: 5c038aa8-5351-4f13-8fc5-32674a0f6dce {{(pid=119305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:23:47.450971 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-df251953-28ce-4e46-8eb1-b55c2838be31 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "POST /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099472 Oct 26 11:23:47.450971 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 286/583] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Oct 26 11:23:47 2022] POST /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 11:23:47.457578 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-055fff06-b7fb-4ba4-b8b3-a810d07fcef5 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:47.457578 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-055fff06-b7fb-4ba4-b8b3-a810d07fcef5 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: a45dcfbe-3437-4feb-a827-dcfc141a24f9] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:47.463302 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-055fff06-b7fb-4ba4-b8b3-a810d07fcef5 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:47.463808 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-055fff06-b7fb-4ba4-b8b3-a810d07fcef5 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:47.464257 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-055fff06-b7fb-4ba4-b8b3-a810d07fcef5 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:47.464924 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-055fff06-b7fb-4ba4-b8b3-a810d07fcef5 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:47.465375 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-055fff06-b7fb-4ba4-b8b3-a810d07fcef5 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:47.465798 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-055fff06-b7fb-4ba4-b8b3-a810d07fcef5 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:47.490098 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-055fff06-b7fb-4ba4-b8b3-a810d07fcef5 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: a45dcfbe-3437-4feb-a827-dcfc141a24f9] Going to try to terminate instance {{(pid=119306) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 11:23:47.752056 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-055fff06-b7fb-4ba4-b8b3-a810d07fcef5 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9" status: 204 len: 0 microversion: 2.1 time: 0.300025 Oct 26 11:23:47.758290 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 298/584] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Oct 26 11:23:47 2022] DELETE /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 11:23:47.760837 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-e8c90fc8-a36d-4bac-b678-a6c3c58b485a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:47.761482 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-e8c90fc8-a36d-4bac-b678-a6c3c58b485a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: a45dcfbe-3437-4feb-a827-dcfc141a24f9] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:47.768129 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e8c90fc8-a36d-4bac-b678-a6c3c58b485a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:47.768638 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e8c90fc8-a36d-4bac-b678-a6c3c58b485a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:47.769075 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e8c90fc8-a36d-4bac-b678-a6c3c58b485a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:47.769761 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e8c90fc8-a36d-4bac-b678-a6c3c58b485a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:47.770214 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e8c90fc8-a36d-4bac-b678-a6c3c58b485a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:47.770635 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e8c90fc8-a36d-4bac-b678-a6c3c58b485a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:47.773358 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:23:47.901904 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-e8c90fc8-a36d-4bac-b678-a6c3c58b485a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:47.909805 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-e8c90fc8-a36d-4bac-b678-a6c3c58b485a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9" status: 200 len: 1679 microversion: 2.1 time: 0.152943 Oct 26 11:23:47.910357 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 287/585] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:23:47 2022] GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:23:48.934700 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-a25fa02f-73af-4496-b33f-d67fc464cc8c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:48.935431 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-a25fa02f-73af-4496-b33f-d67fc464cc8c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: a45dcfbe-3437-4feb-a827-dcfc141a24f9] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:48.941711 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a25fa02f-73af-4496-b33f-d67fc464cc8c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:48.942186 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a25fa02f-73af-4496-b33f-d67fc464cc8c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:48.942619 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a25fa02f-73af-4496-b33f-d67fc464cc8c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:48.944015 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a25fa02f-73af-4496-b33f-d67fc464cc8c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:48.944464 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a25fa02f-73af-4496-b33f-d67fc464cc8c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:48.944881 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a25fa02f-73af-4496-b33f-d67fc464cc8c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:49.077613 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-a25fa02f-73af-4496-b33f-d67fc464cc8c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:49.085230 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-a25fa02f-73af-4496-b33f-d67fc464cc8c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9" status: 200 len: 1679 microversion: 2.1 time: 0.154860 Oct 26 11:23:49.085791 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 299/586] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:23:48 2022] GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:23:50.109037 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-3a515dbb-043c-44ba-b1af-44aeef6b2380 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:50.109651 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-3a515dbb-043c-44ba-b1af-44aeef6b2380 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: a45dcfbe-3437-4feb-a827-dcfc141a24f9] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:50.116058 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3a515dbb-043c-44ba-b1af-44aeef6b2380 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:50.116536 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3a515dbb-043c-44ba-b1af-44aeef6b2380 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:50.116967 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3a515dbb-043c-44ba-b1af-44aeef6b2380 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:50.117651 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3a515dbb-043c-44ba-b1af-44aeef6b2380 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:50.118100 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3a515dbb-043c-44ba-b1af-44aeef6b2380 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:50.118519 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3a515dbb-043c-44ba-b1af-44aeef6b2380 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:50.342342 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-3a515dbb-043c-44ba-b1af-44aeef6b2380 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:50.350204 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-3a515dbb-043c-44ba-b1af-44aeef6b2380 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9" status: 200 len: 1679 microversion: 2.1 time: 0.245008 Oct 26 11:23:50.350774 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 288/587] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:23:50 2022] GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9 => generated 1679 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:23:50.826183 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-832e6b7e-7f4e-42f4-a0c6-54399c7a10f8 req-90861b96-db85-4876-85dc-2862dd941510 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a45dcfbe-3437-4feb-a827-dcfc141a24f9", "name": "network-vif-deleted", "tag": "6a64fdd0-7bad-40da-928f-79e63d46879e"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:23:50.837362 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-832e6b7e-7f4e-42f4-a0c6-54399c7a10f8 req-90861b96-db85-4876-85dc-2862dd941510 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:50.837362 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-832e6b7e-7f4e-42f4-a0c6-54399c7a10f8 req-90861b96-db85-4876-85dc-2862dd941510 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:50.837971 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-832e6b7e-7f4e-42f4-a0c6-54399c7a10f8 req-90861b96-db85-4876-85dc-2862dd941510 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:50.849258 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-832e6b7e-7f4e-42f4-a0c6-54399c7a10f8 req-90861b96-db85-4876-85dc-2862dd941510 service nova] Creating event network-vif-deleted:6a64fdd0-7bad-40da-928f-79e63d46879e for instance a45dcfbe-3437-4feb-a827-dcfc141a24f9 on hv-cinder-81558 Oct 26 11:23:50.855017 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-832e6b7e-7f4e-42f4-a0c6-54399c7a10f8 req-90861b96-db85-4876-85dc-2862dd941510 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032459 Oct 26 11:23:50.855627 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 300/588] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:23:51.373393 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-3b50d695-fd3b-44a9-96b7-f38d96adcc6a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:51.374547 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-3b50d695-fd3b-44a9-96b7-f38d96adcc6a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: a45dcfbe-3437-4feb-a827-dcfc141a24f9] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:51.383037 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3b50d695-fd3b-44a9-96b7-f38d96adcc6a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:51.383770 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3b50d695-fd3b-44a9-96b7-f38d96adcc6a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:51.384552 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3b50d695-fd3b-44a9-96b7-f38d96adcc6a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:51.385718 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3b50d695-fd3b-44a9-96b7-f38d96adcc6a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:51.386331 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3b50d695-fd3b-44a9-96b7-f38d96adcc6a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:51.387205 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3b50d695-fd3b-44a9-96b7-f38d96adcc6a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:51.421939 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3b50d695-fd3b-44a9-96b7-f38d96adcc6a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:51.422759 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3b50d695-fd3b-44a9-96b7-f38d96adcc6a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:51.423272 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3b50d695-fd3b-44a9-96b7-f38d96adcc6a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:51.423724 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.objects.instance [None req-3b50d695-fd3b-44a9-96b7-f38d96adcc6a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lazy-loading 'fault' on Instance uuid a45dcfbe-3437-4feb-a827-dcfc141a24f9 {{(pid=119305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:23:51.467638 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-3b50d695-fd3b-44a9-96b7-f38d96adcc6a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:51.476680 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-3b50d695-fd3b-44a9-96b7-f38d96adcc6a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9" status: 200 len: 1330 microversion: 2.1 time: 0.106919 Oct 26 11:23:51.477995 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 289/589] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:23:51 2022] GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9 => generated 1330 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:23:52.502105 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-08000949-2664-472e-9988-533c6e919347 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:52.502743 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-08000949-2664-472e-9988-533c6e919347 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: a45dcfbe-3437-4feb-a827-dcfc141a24f9] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:52.508904 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-08000949-2664-472e-9988-533c6e919347 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:52.509395 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-08000949-2664-472e-9988-533c6e919347 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:52.509830 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-08000949-2664-472e-9988-533c6e919347 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:52.510517 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-08000949-2664-472e-9988-533c6e919347 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:52.511001 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-08000949-2664-472e-9988-533c6e919347 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:52.511429 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-08000949-2664-472e-9988-533c6e919347 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:52.524741 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.wsgi [None req-08000949-2664-472e-9988-533c6e919347 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] HTTP exception thrown: Instance a45dcfbe-3437-4feb-a827-dcfc141a24f9 could not be found. Oct 26 11:23:52.526336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-08000949-2664-472e-9988-533c6e919347 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Request method failure captured: Oct 26 11:23:52.526336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: request: GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9 HTTP/1.1 Oct 26 11:23:52.526336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept: application/json Oct 26 11:23:52.526336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept-Encoding: identity Oct 26 11:23:52.526336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Connection: close Oct 26 11:23:52.526336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Length: 0 Oct 26 11:23:52.526336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Type: application/json Oct 26 11:23:52.526336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Host: 10.222.0.42 Oct 26 11:23:52.526336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Openstack-System-Scope: None Oct 26 11:23:52.526336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: User-Agent: python-urllib3/1.26.12 Oct 26 11:23:52.526336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Auth-Token: gAAAAABjWRd0c_l4dNmZmsslzgq0Y1mw7cHb2LyArYA_xomuSGUALJJhwUTg-8wegSnjp12OMWl50wz-0CzDaxBHziSvRsAIfgm9nG8oyGTTyhi4gK_QpH-0WiSM5GZmswPu8j2lHFCwK-c7q-bBx1gr_dj9FZxEy_m8cDa2tIsj3jWPztpcm3k Oct 26 11:23:52.526336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Id: None Oct 26 11:23:52.526336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Name: None Oct 26 11:23:52.526336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Identity-Status: Confirmed Oct 26 11:23:52.526336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Is-Admin-Project: True Oct 26 11:23:52.526336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Id: default Oct 26 11:23:52.526336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Name: Default Oct 26 11:23:52.526336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Id: 724121c2144843b7adc7e17312613c9d Oct 26 11:23:52.526336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:23:52.526336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Role: member,reader Oct 26 11:23:52.526336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Roles: member,reader Oct 26 11:23:52.527863 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_724121c2144843b7adc7e17312613c9d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724121c2144843b7adc7e17312613c9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/724121c2144843b7adc7e17312613c9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724121c2144843b7adc7e17312613c9d"}]}] Oct 26 11:23:52.527863 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:23:52.527863 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Id: 724121c2144843b7adc7e17312613c9d Oct 26 11:23:52.527863 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:23:52.527863 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User: tempest-AttachVolumeNegativeTest-1560590927-project Oct 26 11:23:52.527863 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Id: default Oct 26 11:23:52.527863 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Name: Default Oct 26 11:23:52.527863 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Id: e031dd9da25146eebb8813dc8bad8b85 Oct 26 11:23:52.527863 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Name: tempest-AttachVolumeNegativeTest-1560590927-project Oct 26 11:23:52.527863 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: method: > Oct 26 11:23:52.527863 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: exception: Instance a45dcfbe-3437-4feb-a827-dcfc141a24f9 could not be found. Oct 26 11:23:52.527863 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: action_args: {'id': 'a45dcfbe-3437-4feb-a827-dcfc141a24f9'} Oct 26 11:23:52.528796 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:23:52.528796 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:23:52.528796 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:23:52.528796 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:23:52.528796 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:23:52.528796 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:23:52.528796 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:23:52.528796 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:23:52.528796 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:23:52.528796 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:23:52.528796 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a45dcfbe-3437-4feb-a827-dcfc141a24f9 could not be found. Oct 26 11:23:52.528796 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:23:52.528796 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:23:52.528796 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:23:52.528796 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:23:52.528796 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:23:52.528796 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:23:52.528796 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:23:52.528796 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:23:52.528796 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:23:52.530298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:23:52.530298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 11:23:52.530298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 11:23:52.530298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:23:52.530298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:23:52.530298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:23:52.530298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:23:52.530298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a45dcfbe-3437-4feb-a827-dcfc141a24f9 could not be found. Oct 26 11:23:52.530298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:23:52.530298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:23:52.530298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:23:52.530298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:23:52.530298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:23:52.530298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:23:52.530298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:23:52.530298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:23:52.530298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a45dcfbe-3437-4feb-a827-dcfc141a24f9 could not be found. Oct 26 11:23:52.530298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:23:52.531995 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-08000949-2664-472e-9988-533c6e919347 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Returning 404 to user: Instance a45dcfbe-3437-4feb-a827-dcfc141a24f9 could not be found. {{(pid=119306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:23:52.531995 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-08000949-2664-472e-9988-533c6e919347 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9" status: 404 len: 111 microversion: 2.1 time: 0.030358 Oct 26 11:23:52.531995 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 301/590] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:23:52 2022] GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:23:52.536798 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-8e4572e1-c476-4dcd-8864-03acb8100fe3 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '.version_select at 0x7f6b937d85e0>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:52.620640 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-8e4572e1-c476-4dcd-8864-03acb8100fe3 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-709010892" status: 202 len: 0 microversion: 2.1 time: 0.087586 Oct 26 11:23:52.621219 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 290/591] 10.222.0.42 () {58 vars in 1218 bytes} [Wed Oct 26 11:23:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-709010892 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 11:23:53.420943 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e714bb05-22ec-4c9d-9be4-625bd18c3198 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:53.421421 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-e714bb05-22ec-4c9d-9be4-625bd18c3198 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:53.427812 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e714bb05-22ec-4c9d-9be4-625bd18c3198 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:53.428305 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e714bb05-22ec-4c9d-9be4-625bd18c3198 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:53.428738 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e714bb05-22ec-4c9d-9be4-625bd18c3198 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:53.429417 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e714bb05-22ec-4c9d-9be4-625bd18c3198 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:53.429866 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e714bb05-22ec-4c9d-9be4-625bd18c3198 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:53.430285 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e714bb05-22ec-4c9d-9be4-625bd18c3198 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:53.510087 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.objects.instance [None req-e714bb05-22ec-4c9d-9be4-625bd18c3198 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lazy-loading 'services' on Instance uuid 5c038aa8-5351-4f13-8fc5-32674a0f6dce {{(pid=119306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:23:53.732446 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-e714bb05-22ec-4c9d-9be4-625bd18c3198 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce/os-volume_attachments/3b3e9ee3-bf23-476f-b058-a1a30b798b8b" status: 202 len: 0 microversion: 2.1 time: 0.315272 Oct 26 11:23:53.733062 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 302/592] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Oct 26 11:23:53 2022] DELETE /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce/os-volume_attachments/3b3e9ee3-bf23-476f-b058-a1a30b798b8b => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 11:23:53.742910 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-4e9f5b09-3ca5-45b3-b220-a585dd2ba462 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:53.746250 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-4e9f5b09-3ca5-45b3-b220-a585dd2ba462 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:53.753215 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4e9f5b09-3ca5-45b3-b220-a585dd2ba462 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:53.756458 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4e9f5b09-3ca5-45b3-b220-a585dd2ba462 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:53.756458 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4e9f5b09-3ca5-45b3-b220-a585dd2ba462 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:53.756458 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4e9f5b09-3ca5-45b3-b220-a585dd2ba462 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:53.756458 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4e9f5b09-3ca5-45b3-b220-a585dd2ba462 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:53.756860 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4e9f5b09-3ca5-45b3-b220-a585dd2ba462 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:53.785191 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-4e9f5b09-3ca5-45b3-b220-a585dd2ba462 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047195 Oct 26 11:23:53.785698 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 291/593] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Oct 26 11:23:53 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:23:54.798796 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-7d724d19-aad5-4e5e-a67a-a0e7e65222f7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:54.801000 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-7d724d19-aad5-4e5e-a67a-a0e7e65222f7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:54.807627 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7d724d19-aad5-4e5e-a67a-a0e7e65222f7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:54.808102 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7d724d19-aad5-4e5e-a67a-a0e7e65222f7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:54.808531 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7d724d19-aad5-4e5e-a67a-a0e7e65222f7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:54.809213 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7d724d19-aad5-4e5e-a67a-a0e7e65222f7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:54.809659 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7d724d19-aad5-4e5e-a67a-a0e7e65222f7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:54.810077 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7d724d19-aad5-4e5e-a67a-a0e7e65222f7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:54.840919 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-7d724d19-aad5-4e5e-a67a-a0e7e65222f7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047008 Oct 26 11:23:54.841467 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 303/594] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Oct 26 11:23:54 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:23:55.853475 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a052e112-3a3d-4cba-9a8d-f11f3c691392 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:55.855666 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-a052e112-3a3d-4cba-9a8d-f11f3c691392 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:55.862169 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a052e112-3a3d-4cba-9a8d-f11f3c691392 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:55.862647 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a052e112-3a3d-4cba-9a8d-f11f3c691392 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:55.863105 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a052e112-3a3d-4cba-9a8d-f11f3c691392 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:55.863788 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a052e112-3a3d-4cba-9a8d-f11f3c691392 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:55.864236 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a052e112-3a3d-4cba-9a8d-f11f3c691392 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:55.864685 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a052e112-3a3d-4cba-9a8d-f11f3c691392 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:55.895128 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-a052e112-3a3d-4cba-9a8d-f11f3c691392 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045703 Oct 26 11:23:55.896322 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 292/595] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Oct 26 11:23:55 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 11:23:55.958728 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-a7f942c1-9b73-47ad-89b8-8ff59a79c31c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:55.959244 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-a7f942c1-9b73-47ad-89b8-8ff59a79c31c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:55.965492 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a7f942c1-9b73-47ad-89b8-8ff59a79c31c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:55.965966 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a7f942c1-9b73-47ad-89b8-8ff59a79c31c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:55.966395 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a7f942c1-9b73-47ad-89b8-8ff59a79c31c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:55.967101 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a7f942c1-9b73-47ad-89b8-8ff59a79c31c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:55.967545 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a7f942c1-9b73-47ad-89b8-8ff59a79c31c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:55.967958 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a7f942c1-9b73-47ad-89b8-8ff59a79c31c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:55.991893 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-a7f942c1-9b73-47ad-89b8-8ff59a79c31c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Going to try to terminate instance {{(pid=119306) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 11:23:56.304813 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-a7f942c1-9b73-47ad-89b8-8ff59a79c31c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 204 len: 0 microversion: 2.1 time: 0.350236 Oct 26 11:23:56.305430 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 304/596] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Oct 26 11:23:55 2022] DELETE /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 11:23:56.313656 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-4923f0b7-8256-48de-84e6-624ed4dff63b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:56.314328 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-4923f0b7-8256-48de-84e6-624ed4dff63b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:56.321033 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4923f0b7-8256-48de-84e6-624ed4dff63b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:56.321508 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4923f0b7-8256-48de-84e6-624ed4dff63b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:56.321942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4923f0b7-8256-48de-84e6-624ed4dff63b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:56.322622 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4923f0b7-8256-48de-84e6-624ed4dff63b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:56.323096 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4923f0b7-8256-48de-84e6-624ed4dff63b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:56.323517 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4923f0b7-8256-48de-84e6-624ed4dff63b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:56.448754 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-4923f0b7-8256-48de-84e6-624ed4dff63b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:56.456316 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-4923f0b7-8256-48de-84e6-624ed4dff63b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1683 microversion: 2.1 time: 0.146522 Oct 26 11:23:56.456874 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 293/597] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:23:56 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1683 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:23:57.479622 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-282becd1-3d56-4f19-b07f-bd6582e37360 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:57.480321 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-282becd1-3d56-4f19-b07f-bd6582e37360 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:57.486620 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-282becd1-3d56-4f19-b07f-bd6582e37360 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:57.487135 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-282becd1-3d56-4f19-b07f-bd6582e37360 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:57.487936 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-282becd1-3d56-4f19-b07f-bd6582e37360 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:57.488250 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-282becd1-3d56-4f19-b07f-bd6582e37360 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:57.488706 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-282becd1-3d56-4f19-b07f-bd6582e37360 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:57.489132 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-282becd1-3d56-4f19-b07f-bd6582e37360 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:57.614505 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-282becd1-3d56-4f19-b07f-bd6582e37360 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:57.622146 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-282becd1-3d56-4f19-b07f-bd6582e37360 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1683 microversion: 2.1 time: 0.146894 Oct 26 11:23:57.622715 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 305/598] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:23:57 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1683 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:23:58.208835 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-91b94ff2-2591-441a-9b7d-d52ec140d656 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:23:58.209457 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-91b94ff2-2591-441a-9b7d-d52ec140d656 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:58.215371 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-91b94ff2-2591-441a-9b7d-d52ec140d656 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:58.215853 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-91b94ff2-2591-441a-9b7d-d52ec140d656 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:58.216291 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-91b94ff2-2591-441a-9b7d-d52ec140d656 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:58.216980 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-91b94ff2-2591-441a-9b7d-d52ec140d656 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:58.217432 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-91b94ff2-2591-441a-9b7d-d52ec140d656 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:58.217856 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-91b94ff2-2591-441a-9b7d-d52ec140d656 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:58.241222 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.objects.instance [None req-91b94ff2-2591-441a-9b7d-d52ec140d656 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lazy-loading 'flavor' on Instance uuid e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 {{(pid=119305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:23:58.520844 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-91b94ff2-2591-441a-9b7d-d52ec140d656 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "POST /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991/action" status: 202 len: 0 microversion: 2.1 time: 0.315414 Oct 26 11:23:58.521442 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 294/599] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Oct 26 11:23:58 2022] POST /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 11:23:58.530152 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-d3612c9a-ab55-4563-87fd-494d7d31c663 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:58.535137 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-d3612c9a-ab55-4563-87fd-494d7d31c663 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:58.538194 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d3612c9a-ab55-4563-87fd-494d7d31c663 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:58.538705 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d3612c9a-ab55-4563-87fd-494d7d31c663 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:58.539180 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d3612c9a-ab55-4563-87fd-494d7d31c663 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:58.539880 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d3612c9a-ab55-4563-87fd-494d7d31c663 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:58.540329 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d3612c9a-ab55-4563-87fd-494d7d31c663 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:58.540747 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d3612c9a-ab55-4563-87fd-494d7d31c663 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:58.646719 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-9c5b04ed-afc6-4d46-9ba3-13a767bca0af tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:58.647714 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-9c5b04ed-afc6-4d46-9ba3-13a767bca0af tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:58.654220 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9c5b04ed-afc6-4d46-9ba3-13a767bca0af tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:58.654716 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9c5b04ed-afc6-4d46-9ba3-13a767bca0af tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:58.655437 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9c5b04ed-afc6-4d46-9ba3-13a767bca0af tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:58.656167 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9c5b04ed-afc6-4d46-9ba3-13a767bca0af tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:58.656619 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9c5b04ed-afc6-4d46-9ba3-13a767bca0af tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:58.657045 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9c5b04ed-afc6-4d46-9ba3-13a767bca0af tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:58.685263 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-d3612c9a-ab55-4563-87fd-494d7d31c663 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:58.693315 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-d3612c9a-ab55-4563-87fd-494d7d31c663 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1568 microversion: 2.1 time: 0.167253 Oct 26 11:23:58.695603 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 306/600] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:23:58 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:23:58.744896 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-9c5b04ed-afc6-4d46-9ba3-13a767bca0af tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:58.753103 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-9c5b04ed-afc6-4d46-9ba3-13a767bca0af tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1616 microversion: 2.1 time: 0.111114 Oct 26 11:23:58.758710 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 295/601] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:23:58 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1616 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:23:58.779728 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-ff8a7479-4ab3-4971-94a0-ccd442f69651 req-1105bed1-6f37-4646-b166-78ec0f8970e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c038aa8-5351-4f13-8fc5-32674a0f6dce", "name": "network-vif-deleted", "tag": "caf5feb7-a01a-4f65-a03c-f3013b3ab59d"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:23:58.789963 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-ff8a7479-4ab3-4971-94a0-ccd442f69651 req-1105bed1-6f37-4646-b166-78ec0f8970e5 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:58.790438 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-ff8a7479-4ab3-4971-94a0-ccd442f69651 req-1105bed1-6f37-4646-b166-78ec0f8970e5 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:58.791083 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-ff8a7479-4ab3-4971-94a0-ccd442f69651 req-1105bed1-6f37-4646-b166-78ec0f8970e5 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:58.802850 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-ff8a7479-4ab3-4971-94a0-ccd442f69651 req-1105bed1-6f37-4646-b166-78ec0f8970e5 service nova] Creating event network-vif-deleted:caf5feb7-a01a-4f65-a03c-f3013b3ab59d for instance 5c038aa8-5351-4f13-8fc5-32674a0f6dce on hv-cinder-81558 Oct 26 11:23:58.821551 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-ff8a7479-4ab3-4971-94a0-ccd442f69651 req-1105bed1-6f37-4646-b166-78ec0f8970e5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032332 Oct 26 11:23:58.821551 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 307/602] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:23:59.722273 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-59050836-673b-48d0-95e8-cd46a1081d75 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:59.722981 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-59050836-673b-48d0-95e8-cd46a1081d75 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:59.729390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-59050836-673b-48d0-95e8-cd46a1081d75 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:59.729922 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-59050836-673b-48d0-95e8-cd46a1081d75 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:59.730361 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-59050836-673b-48d0-95e8-cd46a1081d75 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:59.731076 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-59050836-673b-48d0-95e8-cd46a1081d75 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:59.731529 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-59050836-673b-48d0-95e8-cd46a1081d75 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:59.731951 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-59050836-673b-48d0-95e8-cd46a1081d75 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:59.788499 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-ae437801-bedd-46c3-b238-5ab1c6cdf74d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:23:59.789215 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-ae437801-bedd-46c3-b238-5ab1c6cdf74d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:23:59.795755 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ae437801-bedd-46c3-b238-5ab1c6cdf74d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:59.796460 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ae437801-bedd-46c3-b238-5ab1c6cdf74d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:59.796893 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ae437801-bedd-46c3-b238-5ab1c6cdf74d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:59.797586 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ae437801-bedd-46c3-b238-5ab1c6cdf74d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:59.798067 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ae437801-bedd-46c3-b238-5ab1c6cdf74d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:59.798481 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ae437801-bedd-46c3-b238-5ab1c6cdf74d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:59.830197 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ae437801-bedd-46c3-b238-5ab1c6cdf74d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:23:59.830675 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ae437801-bedd-46c3-b238-5ab1c6cdf74d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:23:59.831133 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ae437801-bedd-46c3-b238-5ab1c6cdf74d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:23:59.831584 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.objects.instance [None req-ae437801-bedd-46c3-b238-5ab1c6cdf74d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lazy-loading 'fault' on Instance uuid 5c038aa8-5351-4f13-8fc5-32674a0f6dce {{(pid=119306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:23:59.870437 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-59050836-673b-48d0-95e8-cd46a1081d75 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:59.873709 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ae437801-bedd-46c3-b238-5ab1c6cdf74d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:23:59.880036 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-59050836-673b-48d0-95e8-cd46a1081d75 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1568 microversion: 2.1 time: 0.160949 Oct 26 11:23:59.880915 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 296/603] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:23:59 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:23:59.882540 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-ae437801-bedd-46c3-b238-5ab1c6cdf74d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 200 len: 1332 microversion: 2.1 time: 0.105950 Oct 26 11:23:59.883141 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 308/604] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:23:59 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 1332 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:24:00.903673 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-badcb247-9db8-4445-b117-6bc704280374 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:00.904292 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-badcb247-9db8-4445-b117-6bc704280374 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:00.906065 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-fe02392f-54b2-4ca7-b9f6-bc4cfbf7e53b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:00.906678 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-fe02392f-54b2-4ca7-b9f6-bc4cfbf7e53b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:00.911591 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-badcb247-9db8-4445-b117-6bc704280374 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:00.912079 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-badcb247-9db8-4445-b117-6bc704280374 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:00.912511 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-badcb247-9db8-4445-b117-6bc704280374 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:00.913199 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-badcb247-9db8-4445-b117-6bc704280374 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:00.913675 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-badcb247-9db8-4445-b117-6bc704280374 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:00.913901 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fe02392f-54b2-4ca7-b9f6-bc4cfbf7e53b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:00.914095 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-badcb247-9db8-4445-b117-6bc704280374 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:00.914388 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fe02392f-54b2-4ca7-b9f6-bc4cfbf7e53b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:00.914836 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fe02392f-54b2-4ca7-b9f6-bc4cfbf7e53b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:00.915542 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fe02392f-54b2-4ca7-b9f6-bc4cfbf7e53b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:00.915999 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fe02392f-54b2-4ca7-b9f6-bc4cfbf7e53b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:00.916422 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fe02392f-54b2-4ca7-b9f6-bc4cfbf7e53b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:00.929865 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.wsgi [None req-fe02392f-54b2-4ca7-b9f6-bc4cfbf7e53b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] HTTP exception thrown: Instance 5c038aa8-5351-4f13-8fc5-32674a0f6dce could not be found. Oct 26 11:24:00.931532 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-fe02392f-54b2-4ca7-b9f6-bc4cfbf7e53b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Request method failure captured: Oct 26 11:24:00.931532 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: request: GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce HTTP/1.1 Oct 26 11:24:00.931532 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept: application/json Oct 26 11:24:00.931532 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept-Encoding: identity Oct 26 11:24:00.931532 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Connection: close Oct 26 11:24:00.931532 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Length: 0 Oct 26 11:24:00.931532 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Type: application/json Oct 26 11:24:00.931532 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Host: 10.222.0.42 Oct 26 11:24:00.931532 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Openstack-System-Scope: None Oct 26 11:24:00.931532 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: User-Agent: python-urllib3/1.26.12 Oct 26 11:24:00.931532 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Auth-Token: gAAAAABjWRd0c_l4dNmZmsslzgq0Y1mw7cHb2LyArYA_xomuSGUALJJhwUTg-8wegSnjp12OMWl50wz-0CzDaxBHziSvRsAIfgm9nG8oyGTTyhi4gK_QpH-0WiSM5GZmswPu8j2lHFCwK-c7q-bBx1gr_dj9FZxEy_m8cDa2tIsj3jWPztpcm3k Oct 26 11:24:00.931532 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Id: None Oct 26 11:24:00.931532 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Name: None Oct 26 11:24:00.931532 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Identity-Status: Confirmed Oct 26 11:24:00.931532 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Is-Admin-Project: True Oct 26 11:24:00.931532 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Id: default Oct 26 11:24:00.931532 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Name: Default Oct 26 11:24:00.931532 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Id: 724121c2144843b7adc7e17312613c9d Oct 26 11:24:00.931532 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:24:00.931532 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Role: member,reader Oct 26 11:24:00.931532 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Roles: member,reader Oct 26 11:24:00.932864 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_724121c2144843b7adc7e17312613c9d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724121c2144843b7adc7e17312613c9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/724121c2144843b7adc7e17312613c9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724121c2144843b7adc7e17312613c9d"}]}] Oct 26 11:24:00.932864 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:24:00.932864 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Id: 724121c2144843b7adc7e17312613c9d Oct 26 11:24:00.932864 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:24:00.932864 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User: tempest-AttachVolumeNegativeTest-1560590927-project Oct 26 11:24:00.932864 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Id: default Oct 26 11:24:00.932864 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Name: Default Oct 26 11:24:00.932864 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Id: e031dd9da25146eebb8813dc8bad8b85 Oct 26 11:24:00.932864 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Name: tempest-AttachVolumeNegativeTest-1560590927-project Oct 26 11:24:00.932864 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: method: > Oct 26 11:24:00.932864 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: exception: Instance 5c038aa8-5351-4f13-8fc5-32674a0f6dce could not be found. Oct 26 11:24:00.932864 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: action_args: {'id': '5c038aa8-5351-4f13-8fc5-32674a0f6dce'} Oct 26 11:24:00.933571 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:24:00.933571 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:24:00.933571 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:24:00.933571 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:24:00.933571 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:24:00.933571 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:24:00.933571 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:24:00.933571 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:24:00.933571 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:24:00.933571 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:24:00.933571 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c038aa8-5351-4f13-8fc5-32674a0f6dce could not be found. Oct 26 11:24:00.933571 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:24:00.933571 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:24:00.933571 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:24:00.933571 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:24:00.933571 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:24:00.933571 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:24:00.933571 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:24:00.933571 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:24:00.933571 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:24:00.935315 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:24:00.935315 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 11:24:00.935315 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 11:24:00.935315 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:24:00.935315 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:24:00.935315 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:24:00.935315 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:24:00.935315 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c038aa8-5351-4f13-8fc5-32674a0f6dce could not be found. Oct 26 11:24:00.935315 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:24:00.935315 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:24:00.935315 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:24:00.935315 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:24:00.935315 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:24:00.935315 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:24:00.935315 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:24:00.935315 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:24:00.935315 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c038aa8-5351-4f13-8fc5-32674a0f6dce could not be found. Oct 26 11:24:00.935315 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:24:00.936641 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-fe02392f-54b2-4ca7-b9f6-bc4cfbf7e53b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Returning 404 to user: Instance 5c038aa8-5351-4f13-8fc5-32674a0f6dce could not be found. {{(pid=119306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:24:00.936641 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-fe02392f-54b2-4ca7-b9f6-bc4cfbf7e53b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 404 len: 111 microversion: 2.1 time: 0.031014 Oct 26 11:24:00.936641 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 309/605] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:00 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 11:24:00.941541 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-8d81c406-5bcc-42e7-a027-f44a15a55279 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '.version_select at 0x7f6b9376d9d0>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:00.945916 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8d81c406-5bcc-42e7-a027-f44a15a55279 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [53f07c66-ec8f-4976-9235-757ef890b38d] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 11:24:01.043851 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-badcb247-9db8-4445-b117-6bc704280374 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:01.050911 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-badcb247-9db8-4445-b117-6bc704280374 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1568 microversion: 2.1 time: 0.151088 Oct 26 11:24:01.051488 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 297/606] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:00 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:01.953054 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO oslo.messaging._drivers.impl_rabbit [None req-8d81c406-5bcc-42e7-a027-f44a15a55279 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [53f07c66-ec8f-4976-9235-757ef890b38d] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 33224. Oct 26 11:24:02.006870 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-8d81c406-5bcc-42e7-a027-f44a15a55279 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1171470675" status: 202 len: 0 microversion: 2.1 time: 1.068822 Oct 26 11:24:02.007414 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 310/607] 10.222.0.42 () {58 vars in 1221 bytes} [Wed Oct 26 11:24:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1171470675 => generated 0 bytes in 1070 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 11:24:02.073757 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-1f869f42-e3bd-48d8-b545-9d5c3069b35a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:02.074945 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-1f869f42-e3bd-48d8-b545-9d5c3069b35a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:02.081467 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1f869f42-e3bd-48d8-b545-9d5c3069b35a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:02.081953 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1f869f42-e3bd-48d8-b545-9d5c3069b35a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:02.082381 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1f869f42-e3bd-48d8-b545-9d5c3069b35a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:02.083101 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1f869f42-e3bd-48d8-b545-9d5c3069b35a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:02.083550 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1f869f42-e3bd-48d8-b545-9d5c3069b35a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:02.083972 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1f869f42-e3bd-48d8-b545-9d5c3069b35a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:02.214352 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-1f869f42-e3bd-48d8-b545-9d5c3069b35a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:02.223914 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-1f869f42-e3bd-48d8-b545-9d5c3069b35a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1568 microversion: 2.1 time: 0.154160 Oct 26 11:24:02.224650 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 298/608] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:02 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:02.990992 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-4d4d996c-1854-4e35-a34c-896db89d8b2a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Action: 'create', calling method: .version_select at 0x7f6b9380e700>, body: {"keypair": {"name": "tempest-keypair-557646255", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3eu143yzWeqonxl3u+4Il6m+FN5Ne4I76E/gVm/pKlFtNSAHYA7ohF7cUiLdprSw9p4GjUN4qP27prcZSpfuwOg3sum89avDf8SxQx9FBh8XfbedL8sGnVWDSwUbsblg=="}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:24:03.006694 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-4d4d996c-1854-4e35-a34c-896db89d8b2a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Getting quotas for project 724121c2144843b7adc7e17312613c9d. Resources: {'key_pairs'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:24:03.010479 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-4d4d996c-1854-4e35-a34c-896db89d8b2a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Getting quotas for user e031dd9da25146eebb8813dc8bad8b85 and project 724121c2144843b7adc7e17312613c9d. Resources: {'key_pairs'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:24:03.081687 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-4d4d996c-1854-4e35-a34c-896db89d8b2a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.095596 Oct 26 11:24:03.082291 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 311/609] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Oct 26 11:24:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:24:03.248253 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-67052260-e0c5-4a22-b489-f57cd43ebc4e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:03.248873 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-67052260-e0c5-4a22-b489-f57cd43ebc4e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:03.255797 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-67052260-e0c5-4a22-b489-f57cd43ebc4e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:03.256287 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-67052260-e0c5-4a22-b489-f57cd43ebc4e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:03.256728 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-67052260-e0c5-4a22-b489-f57cd43ebc4e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:03.257420 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-67052260-e0c5-4a22-b489-f57cd43ebc4e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:03.257878 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-67052260-e0c5-4a22-b489-f57cd43ebc4e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:03.258308 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-67052260-e0c5-4a22-b489-f57cd43ebc4e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:03.394061 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-67052260-e0c5-4a22-b489-f57cd43ebc4e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:03.401638 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-67052260-e0c5-4a22-b489-f57cd43ebc4e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1568 microversion: 2.1 time: 0.157215 Oct 26 11:24:03.402215 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 299/610] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:03 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:04.425947 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-262a48ae-9c28-4aa9-9d2b-a9c72884661e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:04.430083 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-262a48ae-9c28-4aa9-9d2b-a9c72884661e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:04.433237 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-262a48ae-9c28-4aa9-9d2b-a9c72884661e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:04.433720 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-262a48ae-9c28-4aa9-9d2b-a9c72884661e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:04.434150 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-262a48ae-9c28-4aa9-9d2b-a9c72884661e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:04.434870 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-262a48ae-9c28-4aa9-9d2b-a9c72884661e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:04.435352 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-262a48ae-9c28-4aa9-9d2b-a9c72884661e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:04.435775 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-262a48ae-9c28-4aa9-9d2b-a9c72884661e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:04.438477 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:24:04.571815 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-262a48ae-9c28-4aa9-9d2b-a9c72884661e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:04.579567 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-262a48ae-9c28-4aa9-9d2b-a9c72884661e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1568 microversion: 2.1 time: 0.158043 Oct 26 11:24:04.580161 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 312/611] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:04 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:05.119752 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a1b4d97b-c08a-4c3a-b769-af44b1ad3af7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1562128662", "imageRef": "ed8b5733-339c-4fa7-9767-abef514cb9f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b6fe9a7-2300-42a7-b12b-879816096b76"}], "security_groups": [{"name": "tempest-securitygroup--1266581758"}], "key_name": "tempest-keypair-557646255", "user_data": "}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:24:05.224575 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.network.neutron [None req-a1b4d97b-c08a-4c3a-b769-af44b1ad3af7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] validate_networks() for [('4b6fe9a7-2300-42a7-b12b-879816096b76', None, None, None, None, None)] {{(pid=119305) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 11:24:05.603781 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-0113d838-336e-43cb-824c-4e9c7c5f0dd5 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:05.604390 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-0113d838-336e-43cb-824c-4e9c7c5f0dd5 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:05.610176 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0113d838-336e-43cb-824c-4e9c7c5f0dd5 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:05.610660 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0113d838-336e-43cb-824c-4e9c7c5f0dd5 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:05.611135 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0113d838-336e-43cb-824c-4e9c7c5f0dd5 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:05.611828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0113d838-336e-43cb-824c-4e9c7c5f0dd5 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:05.612283 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0113d838-336e-43cb-824c-4e9c7c5f0dd5 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:05.612708 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0113d838-336e-43cb-824c-4e9c7c5f0dd5 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:05.621917 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-a1b4d97b-c08a-4c3a-b769-af44b1ad3af7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Flavor limits 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 11:24:05.622335 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-a1b4d97b-c08a-4c3a-b769-af44b1ad3af7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Image limits 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 11:24:05.622801 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-a1b4d97b-c08a-4c3a-b769-af44b1ad3af7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Flavor pref 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 11:24:05.623234 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-a1b4d97b-c08a-4c3a-b769-af44b1ad3af7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Image pref 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 11:24:05.623638 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-a1b4d97b-c08a-4c3a-b769-af44b1ad3af7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 11:24:05.632802 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a1b4d97b-c08a-4c3a-b769-af44b1ad3af7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:05.633279 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a1b4d97b-c08a-4c3a-b769-af44b1ad3af7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:05.633736 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a1b4d97b-c08a-4c3a-b769-af44b1ad3af7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:05.634423 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a1b4d97b-c08a-4c3a-b769-af44b1ad3af7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:05.634893 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a1b4d97b-c08a-4c3a-b769-af44b1ad3af7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:05.635317 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a1b4d97b-c08a-4c3a-b769-af44b1ad3af7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:05.652432 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.quota [None req-a1b4d97b-c08a-4c3a-b769-af44b1ad3af7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Getting quotas for project 724121c2144843b7adc7e17312613c9d. Resources: {'cores', 'instances', 'ram'} {{(pid=119305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:24:05.656673 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.quota [None req-a1b4d97b-c08a-4c3a-b769-af44b1ad3af7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Getting quotas for user e031dd9da25146eebb8813dc8bad8b85 and project 724121c2144843b7adc7e17312613c9d. Resources: {'cores', 'instances', 'ram'} {{(pid=119305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:24:05.667700 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-a1b4d97b-c08a-4c3a-b769-af44b1ad3af7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Going to run 1 instances... {{(pid=119305) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 11:24:05.669998 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-a1b4d97b-c08a-4c3a-b769-af44b1ad3af7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed8b5733-339c-4fa7-9767-abef514cb9f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119305) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 11:24:05.743247 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-0113d838-336e-43cb-824c-4e9c7c5f0dd5 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:05.751626 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-0113d838-336e-43cb-824c-4e9c7c5f0dd5 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1568 microversion: 2.1 time: 0.151816 Oct 26 11:24:05.752199 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 313/612] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:05 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:24:05.801753 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-a1b4d97b-c08a-4c3a-b769-af44b1ad3af7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.686283 Oct 26 11:24:05.802404 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 300/613] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Oct 26 11:24:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 26 11:24:05.813545 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-62d733a0-5965-42c0-8144-03ae2cffaf4f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:05.814393 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-62d733a0-5965-42c0-8144-03ae2cffaf4f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:05.867182 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-62d733a0-5965-42c0-8144-03ae2cffaf4f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:05.874008 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-62d733a0-5965-42c0-8144-03ae2cffaf4f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89" status: 200 len: 1241 microversion: 2.1 time: 0.064320 Oct 26 11:24:05.874660 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 314/614] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:05 2022] GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89 => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:24:06.776130 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a75390df-1d23-427b-b0c1-330737e9f63c tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:06.776735 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-a75390df-1d23-427b-b0c1-330737e9f63c tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:06.782901 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a75390df-1d23-427b-b0c1-330737e9f63c tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:06.783382 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a75390df-1d23-427b-b0c1-330737e9f63c tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:06.783818 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a75390df-1d23-427b-b0c1-330737e9f63c tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:06.784498 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a75390df-1d23-427b-b0c1-330737e9f63c tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:06.784946 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a75390df-1d23-427b-b0c1-330737e9f63c tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:06.785363 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a75390df-1d23-427b-b0c1-330737e9f63c tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:06.897291 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-1a06d83a-34a5-4613-b781-ecb27b95ba00 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:06.897901 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-1a06d83a-34a5-4613-b781-ecb27b95ba00 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:06.904656 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1a06d83a-34a5-4613-b781-ecb27b95ba00 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:06.905141 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1a06d83a-34a5-4613-b781-ecb27b95ba00 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:06.905568 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1a06d83a-34a5-4613-b781-ecb27b95ba00 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:06.906291 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1a06d83a-34a5-4613-b781-ecb27b95ba00 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:06.906736 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1a06d83a-34a5-4613-b781-ecb27b95ba00 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:06.907209 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1a06d83a-34a5-4613-b781-ecb27b95ba00 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:06.918386 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-a75390df-1d23-427b-b0c1-330737e9f63c tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:06.929055 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-a75390df-1d23-427b-b0c1-330737e9f63c tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1568 microversion: 2.1 time: 0.157257 Oct 26 11:24:06.929914 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 301/615] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:06 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:06.981771 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-1a06d83a-34a5-4613-b781-ecb27b95ba00 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:06.990327 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-1a06d83a-34a5-4613-b781-ecb27b95ba00 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89" status: 200 len: 1245 microversion: 2.1 time: 0.097282 Oct 26 11:24:06.990955 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 315/616] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:06 2022] GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89 => generated 1245 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:24:08.011960 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-1f675d7e-2c08-4e77-ac74-38488ed8841a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:08.012537 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-1f675d7e-2c08-4e77-ac74-38488ed8841a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:08.013188 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-803af795-318b-4f7a-b2b7-e454e1f71f66 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:08.013814 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-803af795-318b-4f7a-b2b7-e454e1f71f66 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:08.019526 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1f675d7e-2c08-4e77-ac74-38488ed8841a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:08.020026 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1f675d7e-2c08-4e77-ac74-38488ed8841a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:08.020261 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-803af795-318b-4f7a-b2b7-e454e1f71f66 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:08.020471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1f675d7e-2c08-4e77-ac74-38488ed8841a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:08.020715 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-803af795-318b-4f7a-b2b7-e454e1f71f66 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:08.021145 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-803af795-318b-4f7a-b2b7-e454e1f71f66 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:08.021256 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1f675d7e-2c08-4e77-ac74-38488ed8841a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:08.021622 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1f675d7e-2c08-4e77-ac74-38488ed8841a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:08.021832 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-803af795-318b-4f7a-b2b7-e454e1f71f66 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:08.022049 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1f675d7e-2c08-4e77-ac74-38488ed8841a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:08.022282 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-803af795-318b-4f7a-b2b7-e454e1f71f66 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:08.022701 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-803af795-318b-4f7a-b2b7-e454e1f71f66 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:08.087935 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-803af795-318b-4f7a-b2b7-e454e1f71f66 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:08.096800 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-803af795-318b-4f7a-b2b7-e454e1f71f66 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89" status: 200 len: 1301 microversion: 2.1 time: 0.087290 Oct 26 11:24:08.097620 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 316/617] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:08 2022] GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89 => generated 1301 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:24:08.244273 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-1f675d7e-2c08-4e77-ac74-38488ed8841a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:08.251947 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-1f675d7e-2c08-4e77-ac74-38488ed8841a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1568 microversion: 2.1 time: 0.244233 Oct 26 11:24:08.252517 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 302/618] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:08 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1568 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:09.121269 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-79b8da49-97af-44e0-9964-4836dbd23734 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:09.122733 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-79b8da49-97af-44e0-9964-4836dbd23734 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:09.126694 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:24:09.130617 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-79b8da49-97af-44e0-9964-4836dbd23734 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:09.131308 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-79b8da49-97af-44e0-9964-4836dbd23734 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:09.131758 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-79b8da49-97af-44e0-9964-4836dbd23734 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:09.132492 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-79b8da49-97af-44e0-9964-4836dbd23734 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:09.132954 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-79b8da49-97af-44e0-9964-4836dbd23734 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:09.133382 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-79b8da49-97af-44e0-9964-4836dbd23734 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:09.270195 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-79b8da49-97af-44e0-9964-4836dbd23734 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:09.275065 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-7525cb70-4acd-4ad0-9801-839a53ea936e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:09.275783 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-7525cb70-4acd-4ad0-9801-839a53ea936e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:09.278503 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-79b8da49-97af-44e0-9964-4836dbd23734 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89" status: 200 len: 1367 microversion: 2.1 time: 0.161666 Oct 26 11:24:09.279311 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 317/619] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:09 2022] GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:09.284148 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7525cb70-4acd-4ad0-9801-839a53ea936e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:09.284278 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7525cb70-4acd-4ad0-9801-839a53ea936e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:09.284680 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7525cb70-4acd-4ad0-9801-839a53ea936e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:09.285883 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7525cb70-4acd-4ad0-9801-839a53ea936e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:09.286350 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7525cb70-4acd-4ad0-9801-839a53ea936e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:09.286768 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7525cb70-4acd-4ad0-9801-839a53ea936e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:09.302810 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:24:09.502664 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-7525cb70-4acd-4ad0-9801-839a53ea936e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:09.511445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-7525cb70-4acd-4ad0-9801-839a53ea936e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1568 microversion: 2.1 time: 0.240739 Oct 26 11:24:09.512024 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 303/620] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:09 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1568 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:24:09.764219 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-14845173-572a-4b0f-972c-970c4bbaab76 req-55d54809-1734-48f5-a4ef-87fd27816f0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be2a7ec3-e66b-477d-99da-8d730066cf89", "tag": "e22707f0-8877-4f00-ab3e-d053cdf8c8fa"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:24:09.774350 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-14845173-572a-4b0f-972c-970c4bbaab76 req-55d54809-1734-48f5-a4ef-87fd27816f0b service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:09.774848 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-14845173-572a-4b0f-972c-970c4bbaab76 req-55d54809-1734-48f5-a4ef-87fd27816f0b service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:09.775274 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-14845173-572a-4b0f-972c-970c4bbaab76 req-55d54809-1734-48f5-a4ef-87fd27816f0b service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:09.786620 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-14845173-572a-4b0f-972c-970c4bbaab76 req-55d54809-1734-48f5-a4ef-87fd27816f0b service nova] Creating event network-changed:e22707f0-8877-4f00-ab3e-d053cdf8c8fa for instance be2a7ec3-e66b-477d-99da-8d730066cf89 on hv-cinder-81558 Oct 26 11:24:09.791682 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-14845173-572a-4b0f-972c-970c4bbaab76 req-55d54809-1734-48f5-a4ef-87fd27816f0b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031269 Oct 26 11:24:09.792281 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 318/621] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:24:10.303516 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-9c992b07-89a5-4bd4-8f80-0f19464bf9a2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:10.304125 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-9c992b07-89a5-4bd4-8f80-0f19464bf9a2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:10.310811 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9c992b07-89a5-4bd4-8f80-0f19464bf9a2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:10.316099 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9c992b07-89a5-4bd4-8f80-0f19464bf9a2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:10.316099 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9c992b07-89a5-4bd4-8f80-0f19464bf9a2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:10.316099 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9c992b07-89a5-4bd4-8f80-0f19464bf9a2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:10.316099 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9c992b07-89a5-4bd4-8f80-0f19464bf9a2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:10.316426 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9c992b07-89a5-4bd4-8f80-0f19464bf9a2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:10.521359 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-9c992b07-89a5-4bd4-8f80-0f19464bf9a2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:10.529291 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-9c992b07-89a5-4bd4-8f80-0f19464bf9a2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89" status: 200 len: 1367 microversion: 2.1 time: 0.230497 Oct 26 11:24:10.530000 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 304/622] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:10 2022] GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:10.537911 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-6e9d9865-9587-43fa-8a06-3932cf6e5e5a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:10.538684 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-6e9d9865-9587-43fa-8a06-3932cf6e5e5a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:10.545333 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6e9d9865-9587-43fa-8a06-3932cf6e5e5a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:10.545896 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6e9d9865-9587-43fa-8a06-3932cf6e5e5a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:10.546379 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6e9d9865-9587-43fa-8a06-3932cf6e5e5a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:10.550606 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6e9d9865-9587-43fa-8a06-3932cf6e5e5a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:10.550606 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6e9d9865-9587-43fa-8a06-3932cf6e5e5a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:10.550606 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6e9d9865-9587-43fa-8a06-3932cf6e5e5a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:10.683753 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-6e9d9865-9587-43fa-8a06-3932cf6e5e5a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:10.691471 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-6e9d9865-9587-43fa-8a06-3932cf6e5e5a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1568 microversion: 2.1 time: 0.159000 Oct 26 11:24:10.692044 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 319/623] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:10 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:24:11.554904 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-76fac9b3-31f5-4438-83dd-5fbc770b529f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:11.555541 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-76fac9b3-31f5-4438-83dd-5fbc770b529f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:11.562049 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-76fac9b3-31f5-4438-83dd-5fbc770b529f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:11.562537 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-76fac9b3-31f5-4438-83dd-5fbc770b529f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:11.563009 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-76fac9b3-31f5-4438-83dd-5fbc770b529f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:11.563702 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-76fac9b3-31f5-4438-83dd-5fbc770b529f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:11.564154 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-76fac9b3-31f5-4438-83dd-5fbc770b529f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:11.564581 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-76fac9b3-31f5-4438-83dd-5fbc770b529f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:11.689141 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-76fac9b3-31f5-4438-83dd-5fbc770b529f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:11.696665 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-76fac9b3-31f5-4438-83dd-5fbc770b529f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89" status: 200 len: 1367 microversion: 2.1 time: 0.146143 Oct 26 11:24:11.697234 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 305/624] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:11 2022] GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:11.714989 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-f11e8e9d-3713-47bc-9a47-a18eaf2e3ec9 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:11.715635 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-f11e8e9d-3713-47bc-9a47-a18eaf2e3ec9 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:11.722079 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f11e8e9d-3713-47bc-9a47-a18eaf2e3ec9 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:11.723097 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f11e8e9d-3713-47bc-9a47-a18eaf2e3ec9 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:11.723534 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f11e8e9d-3713-47bc-9a47-a18eaf2e3ec9 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:11.724224 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f11e8e9d-3713-47bc-9a47-a18eaf2e3ec9 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:11.724678 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f11e8e9d-3713-47bc-9a47-a18eaf2e3ec9 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:11.725097 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f11e8e9d-3713-47bc-9a47-a18eaf2e3ec9 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:11.853969 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-f11e8e9d-3713-47bc-9a47-a18eaf2e3ec9 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:11.861588 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-f11e8e9d-3713-47bc-9a47-a18eaf2e3ec9 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1568 microversion: 2.1 time: 0.150634 Oct 26 11:24:11.862153 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 320/625] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:11 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:12.719488 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-26450766-c1fe-41ef-a749-0eeddf21b291 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:12.720100 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-26450766-c1fe-41ef-a749-0eeddf21b291 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:12.726837 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-26450766-c1fe-41ef-a749-0eeddf21b291 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:12.727340 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-26450766-c1fe-41ef-a749-0eeddf21b291 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:12.727770 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-26450766-c1fe-41ef-a749-0eeddf21b291 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:12.728456 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-26450766-c1fe-41ef-a749-0eeddf21b291 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:12.728902 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-26450766-c1fe-41ef-a749-0eeddf21b291 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:12.729352 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-26450766-c1fe-41ef-a749-0eeddf21b291 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:12.856393 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-26450766-c1fe-41ef-a749-0eeddf21b291 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:12.864714 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-26450766-c1fe-41ef-a749-0eeddf21b291 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89" status: 200 len: 1367 microversion: 2.1 time: 0.149080 Oct 26 11:24:12.865283 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 306/626] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:12 2022] GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:12.885702 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-05b21feb-4034-47bb-8b81-80e42c051012 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:12.886313 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-05b21feb-4034-47bb-8b81-80e42c051012 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:12.892637 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-05b21feb-4034-47bb-8b81-80e42c051012 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:12.893125 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-05b21feb-4034-47bb-8b81-80e42c051012 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:12.893559 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-05b21feb-4034-47bb-8b81-80e42c051012 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:12.894246 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-05b21feb-4034-47bb-8b81-80e42c051012 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:12.894700 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-05b21feb-4034-47bb-8b81-80e42c051012 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:12.895150 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-05b21feb-4034-47bb-8b81-80e42c051012 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:13.026368 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-05b21feb-4034-47bb-8b81-80e42c051012 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:13.034345 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-05b21feb-4034-47bb-8b81-80e42c051012 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1568 microversion: 2.1 time: 0.152466 Oct 26 11:24:13.035442 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 321/627] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:12 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:13.888016 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-37b27dbc-a6e9-4236-995a-41af23b9246e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:13.888654 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-37b27dbc-a6e9-4236-995a-41af23b9246e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:13.895729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-37b27dbc-a6e9-4236-995a-41af23b9246e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:13.896203 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-37b27dbc-a6e9-4236-995a-41af23b9246e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:13.896631 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-37b27dbc-a6e9-4236-995a-41af23b9246e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:13.897304 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-37b27dbc-a6e9-4236-995a-41af23b9246e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:13.897751 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-37b27dbc-a6e9-4236-995a-41af23b9246e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:13.898169 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-37b27dbc-a6e9-4236-995a-41af23b9246e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:14.059054 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-5e9f9576-7741-481d-9c5b-3b2b97f0cef9 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:14.059667 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-5e9f9576-7741-481d-9c5b-3b2b97f0cef9 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:14.066413 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5e9f9576-7741-481d-9c5b-3b2b97f0cef9 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:14.066918 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5e9f9576-7741-481d-9c5b-3b2b97f0cef9 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:14.067348 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5e9f9576-7741-481d-9c5b-3b2b97f0cef9 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:14.068036 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5e9f9576-7741-481d-9c5b-3b2b97f0cef9 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:14.068482 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5e9f9576-7741-481d-9c5b-3b2b97f0cef9 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:14.068902 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5e9f9576-7741-481d-9c5b-3b2b97f0cef9 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:14.203553 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-5e9f9576-7741-481d-9c5b-3b2b97f0cef9 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:14.211584 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-5e9f9576-7741-481d-9c5b-3b2b97f0cef9 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1568 microversion: 2.1 time: 0.156516 Oct 26 11:24:14.212170 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 322/628] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:14 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:24:14.364949 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-37b27dbc-a6e9-4236-995a-41af23b9246e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:14.372677 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-37b27dbc-a6e9-4236-995a-41af23b9246e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89" status: 200 len: 1367 microversion: 2.1 time: 0.488567 Oct 26 11:24:14.373443 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 307/629] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:13 2022] GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89 => generated 1367 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:15.234915 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-0d17afbb-31bc-413b-8c8e-5f55b2e99280 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:15.235501 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-0d17afbb-31bc-413b-8c8e-5f55b2e99280 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:15.242650 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0d17afbb-31bc-413b-8c8e-5f55b2e99280 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:15.243168 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0d17afbb-31bc-413b-8c8e-5f55b2e99280 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:15.243603 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0d17afbb-31bc-413b-8c8e-5f55b2e99280 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:15.244296 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0d17afbb-31bc-413b-8c8e-5f55b2e99280 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:15.244746 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0d17afbb-31bc-413b-8c8e-5f55b2e99280 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:15.245169 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0d17afbb-31bc-413b-8c8e-5f55b2e99280 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:15.376235 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-0d17afbb-31bc-413b-8c8e-5f55b2e99280 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:15.386276 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-0d17afbb-31bc-413b-8c8e-5f55b2e99280 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1568 microversion: 2.1 time: 0.155206 Oct 26 11:24:15.387041 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 323/630] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:15 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:15.397737 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-da9fcb24-ab27-4d4e-b100-d2c4e3a90e1d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:15.398349 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-da9fcb24-ab27-4d4e-b100-d2c4e3a90e1d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:15.405157 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-da9fcb24-ab27-4d4e-b100-d2c4e3a90e1d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:15.405632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-da9fcb24-ab27-4d4e-b100-d2c4e3a90e1d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:15.406064 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-da9fcb24-ab27-4d4e-b100-d2c4e3a90e1d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:15.406747 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-da9fcb24-ab27-4d4e-b100-d2c4e3a90e1d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:15.407305 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-da9fcb24-ab27-4d4e-b100-d2c4e3a90e1d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:15.407725 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-da9fcb24-ab27-4d4e-b100-d2c4e3a90e1d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:15.421151 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-8f8c0ca4-8da4-42a0-8caf-2d1e8b885acd tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:15.421644 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-8f8c0ca4-8da4-42a0-8caf-2d1e8b885acd tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:15.428002 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8f8c0ca4-8da4-42a0-8caf-2d1e8b885acd tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:15.428482 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8f8c0ca4-8da4-42a0-8caf-2d1e8b885acd tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:15.428913 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8f8c0ca4-8da4-42a0-8caf-2d1e8b885acd tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:15.429600 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8f8c0ca4-8da4-42a0-8caf-2d1e8b885acd tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:15.430052 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8f8c0ca4-8da4-42a0-8caf-2d1e8b885acd tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:15.430475 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8f8c0ca4-8da4-42a0-8caf-2d1e8b885acd tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:15.459167 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-8f8c0ca4-8da4-42a0-8caf-2d1e8b885acd tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a/os-volume_attachments/e1ba4fc9-3476-4c47-9d67-f1a17f84c590" status: 200 len: 194 microversion: 2.20 time: 0.041876 Oct 26 11:24:15.459763 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 324/631] 10.222.0.42 () {60 vars in 1454 bytes} [Wed Oct 26 11:24:15 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a/os-volume_attachments/e1ba4fc9-3476-4c47-9d67-f1a17f84c590 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 11:24:15.531843 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-2e474883-647a-4c8c-a75d-2f02d4c4d32e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:15.532334 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-2e474883-647a-4c8c-a75d-2f02d4c4d32e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:15.538764 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2e474883-647a-4c8c-a75d-2f02d4c4d32e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:15.539396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2e474883-647a-4c8c-a75d-2f02d4c4d32e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:15.539838 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2e474883-647a-4c8c-a75d-2f02d4c4d32e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:15.540534 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2e474883-647a-4c8c-a75d-2f02d4c4d32e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:15.540985 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2e474883-647a-4c8c-a75d-2f02d4c4d32e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:15.541408 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2e474883-647a-4c8c-a75d-2f02d4c4d32e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:15.541965 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-da9fcb24-ab27-4d4e-b100-d2c4e3a90e1d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:15.549731 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-da9fcb24-ab27-4d4e-b100-d2c4e3a90e1d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89" status: 200 len: 1367 microversion: 2.1 time: 0.156942 Oct 26 11:24:15.551002 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 308/632] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:15 2022] GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:15.620874 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.objects.instance [None req-2e474883-647a-4c8c-a75d-2f02d4c4d32e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lazy-loading 'services' on Instance uuid 2821a8ff-1cb6-43c5-9968-1c13e293ad1a {{(pid=119306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:24:15.832401 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-2e474883-647a-4c8c-a75d-2f02d4c4d32e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a/os-volume_attachments/e1ba4fc9-3476-4c47-9d67-f1a17f84c590" status: 202 len: 0 microversion: 2.20 time: 0.304468 Oct 26 11:24:15.832987 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 325/633] 10.222.0.42 () {60 vars in 1457 bytes} [Wed Oct 26 11:24:15 2022] DELETE /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a/os-volume_attachments/e1ba4fc9-3476-4c47-9d67-f1a17f84c590 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 26 11:24:15.841578 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a89e85b5-ae3e-47c7-8bed-42e5c1cfa3db tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:15.843842 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-a89e85b5-ae3e-47c7-8bed-42e5c1cfa3db tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:15.845700 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell0:SELECT=2 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:24:15.846418 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell0:SELECT=6 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:24:15.851745 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a89e85b5-ae3e-47c7-8bed-42e5c1cfa3db tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:15.852228 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a89e85b5-ae3e-47c7-8bed-42e5c1cfa3db tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:15.852738 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a89e85b5-ae3e-47c7-8bed-42e5c1cfa3db tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:15.853570 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a89e85b5-ae3e-47c7-8bed-42e5c1cfa3db tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:15.854034 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a89e85b5-ae3e-47c7-8bed-42e5c1cfa3db tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:15.854482 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a89e85b5-ae3e-47c7-8bed-42e5c1cfa3db tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:15.883420 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-a89e85b5-ae3e-47c7-8bed-42e5c1cfa3db tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046017 Oct 26 11:24:15.883976 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 309/634] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Oct 26 11:24:15 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 11:24:16.410729 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell0:SELECT=6 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:24:16.415545 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-abfa4bad-881b-4a2e-882e-d236ccb1dd6e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:16.416269 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-abfa4bad-881b-4a2e-882e-d236ccb1dd6e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:16.422383 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-abfa4bad-881b-4a2e-882e-d236ccb1dd6e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:16.422901 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-abfa4bad-881b-4a2e-882e-d236ccb1dd6e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:16.423342 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-abfa4bad-881b-4a2e-882e-d236ccb1dd6e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:16.424030 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-abfa4bad-881b-4a2e-882e-d236ccb1dd6e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:16.424528 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-abfa4bad-881b-4a2e-882e-d236ccb1dd6e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:16.425541 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-abfa4bad-881b-4a2e-882e-d236ccb1dd6e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:16.561512 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-abfa4bad-881b-4a2e-882e-d236ccb1dd6e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:16.570192 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-abfa4bad-881b-4a2e-882e-d236ccb1dd6e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1568 microversion: 2.1 time: 0.160396 Oct 26 11:24:16.570766 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 326/635] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:16 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:16.575386 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-5cc69e02-e2f8-429b-b631-88486d9d5770 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:16.576079 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-5cc69e02-e2f8-429b-b631-88486d9d5770 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:16.583468 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5cc69e02-e2f8-429b-b631-88486d9d5770 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:16.583947 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5cc69e02-e2f8-429b-b631-88486d9d5770 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:16.584547 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5cc69e02-e2f8-429b-b631-88486d9d5770 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:16.585648 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5cc69e02-e2f8-429b-b631-88486d9d5770 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:16.586105 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5cc69e02-e2f8-429b-b631-88486d9d5770 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:16.587292 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5cc69e02-e2f8-429b-b631-88486d9d5770 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:16.606626 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-ec7e7d86-0065-46b7-aaa2-8b41828fc51d req-daea67ff-f503-40ba-8ed0-4c6fee15edb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be2a7ec3-e66b-477d-99da-8d730066cf89", "name": "network-vif-plugged", "status": "completed", "tag": "e22707f0-8877-4f00-ab3e-d053cdf8c8fa"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:24:16.616986 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-ec7e7d86-0065-46b7-aaa2-8b41828fc51d req-daea67ff-f503-40ba-8ed0-4c6fee15edb8 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:16.617457 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-ec7e7d86-0065-46b7-aaa2-8b41828fc51d req-daea67ff-f503-40ba-8ed0-4c6fee15edb8 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:16.617879 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-ec7e7d86-0065-46b7-aaa2-8b41828fc51d req-daea67ff-f503-40ba-8ed0-4c6fee15edb8 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:16.630928 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-ec7e7d86-0065-46b7-aaa2-8b41828fc51d req-daea67ff-f503-40ba-8ed0-4c6fee15edb8 service nova] Creating event network-vif-plugged:e22707f0-8877-4f00-ab3e-d053cdf8c8fa for instance be2a7ec3-e66b-477d-99da-8d730066cf89 on hv-cinder-81558 Oct 26 11:24:16.636557 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-ec7e7d86-0065-46b7-aaa2-8b41828fc51d req-daea67ff-f503-40ba-8ed0-4c6fee15edb8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097217 Oct 26 11:24:16.637638 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 310/636] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:24:16.723634 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-5cc69e02-e2f8-429b-b631-88486d9d5770 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:16.731266 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-5cc69e02-e2f8-429b-b631-88486d9d5770 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89" status: 200 len: 1367 microversion: 2.1 time: 0.159507 Oct 26 11:24:16.731830 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 327/637] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:16 2022] GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:16.895994 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-c68a5b13-f5fc-4e0e-8d56-d838cbff3ff4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:16.898314 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-c68a5b13-f5fc-4e0e-8d56-d838cbff3ff4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:16.904663 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c68a5b13-f5fc-4e0e-8d56-d838cbff3ff4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:16.905144 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c68a5b13-f5fc-4e0e-8d56-d838cbff3ff4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:16.905765 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c68a5b13-f5fc-4e0e-8d56-d838cbff3ff4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:16.906461 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c68a5b13-f5fc-4e0e-8d56-d838cbff3ff4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:16.906978 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c68a5b13-f5fc-4e0e-8d56-d838cbff3ff4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:16.912866 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c68a5b13-f5fc-4e0e-8d56-d838cbff3ff4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:16.938767 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-c68a5b13-f5fc-4e0e-8d56-d838cbff3ff4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047070 Oct 26 11:24:16.939353 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 311/638] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Oct 26 11:24:16 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 11:24:17.594887 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-95461b38-6dd5-48e9-aa2a-2c15f34bf99e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:17.595502 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-95461b38-6dd5-48e9-aa2a-2c15f34bf99e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:17.602724 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-95461b38-6dd5-48e9-aa2a-2c15f34bf99e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:17.603277 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-95461b38-6dd5-48e9-aa2a-2c15f34bf99e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:17.603717 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-95461b38-6dd5-48e9-aa2a-2c15f34bf99e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:17.604441 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-95461b38-6dd5-48e9-aa2a-2c15f34bf99e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:17.604891 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-95461b38-6dd5-48e9-aa2a-2c15f34bf99e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:17.605310 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-95461b38-6dd5-48e9-aa2a-2c15f34bf99e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:17.738635 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-95461b38-6dd5-48e9-aa2a-2c15f34bf99e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:17.747113 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-95461b38-6dd5-48e9-aa2a-2c15f34bf99e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1568 microversion: 2.1 time: 0.155505 Oct 26 11:24:17.747113 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 328/639] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:17 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:17.755788 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-427b15f3-13a9-4e5e-a363-36c3524f34f0 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:17.756408 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-427b15f3-13a9-4e5e-a363-36c3524f34f0 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:17.758800 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:24:17.763803 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-427b15f3-13a9-4e5e-a363-36c3524f34f0 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:17.764319 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-427b15f3-13a9-4e5e-a363-36c3524f34f0 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:17.764759 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-427b15f3-13a9-4e5e-a363-36c3524f34f0 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:17.765458 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-427b15f3-13a9-4e5e-a363-36c3524f34f0 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:17.765915 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-427b15f3-13a9-4e5e-a363-36c3524f34f0 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:17.766346 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-427b15f3-13a9-4e5e-a363-36c3524f34f0 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:17.895855 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-427b15f3-13a9-4e5e-a363-36c3524f34f0 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:17.904411 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-427b15f3-13a9-4e5e-a363-36c3524f34f0 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89" status: 200 len: 1367 microversion: 2.1 time: 0.152979 Oct 26 11:24:17.904983 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 312/640] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:17 2022] GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:17.950504 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-d5a1dbb8-bcea-4237-b809-14ca7064a98f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:17.952711 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-d5a1dbb8-bcea-4237-b809-14ca7064a98f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:17.958562 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d5a1dbb8-bcea-4237-b809-14ca7064a98f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:17.959079 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d5a1dbb8-bcea-4237-b809-14ca7064a98f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:17.959516 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d5a1dbb8-bcea-4237-b809-14ca7064a98f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:17.960202 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d5a1dbb8-bcea-4237-b809-14ca7064a98f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:17.960654 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d5a1dbb8-bcea-4237-b809-14ca7064a98f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:17.961072 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d5a1dbb8-bcea-4237-b809-14ca7064a98f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:17.986919 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:24:17.991638 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-d5a1dbb8-bcea-4237-b809-14ca7064a98f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045209 Oct 26 11:24:17.992194 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 329/641] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Oct 26 11:24:17 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:18.057982 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-6475ee3d-68e1-4f22-8a40-2de2c2410fc1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:18.058534 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-6475ee3d-68e1-4f22-8a40-2de2c2410fc1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:18.064480 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6475ee3d-68e1-4f22-8a40-2de2c2410fc1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:18.064996 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6475ee3d-68e1-4f22-8a40-2de2c2410fc1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:18.065464 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6475ee3d-68e1-4f22-8a40-2de2c2410fc1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:18.066152 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6475ee3d-68e1-4f22-8a40-2de2c2410fc1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:18.067244 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6475ee3d-68e1-4f22-8a40-2de2c2410fc1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:18.067671 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6475ee3d-68e1-4f22-8a40-2de2c2410fc1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:18.091768 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-6475ee3d-68e1-4f22-8a40-2de2c2410fc1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Going to try to terminate instance {{(pid=119305) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 11:24:18.324244 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-6475ee3d-68e1-4f22-8a40-2de2c2410fc1 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 204 len: 0 microversion: 2.20 time: 0.269789 Oct 26 11:24:18.324837 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 313/642] 10.222.0.42 () {60 vars in 1280 bytes} [Wed Oct 26 11:24:18 2022] DELETE /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 11:24:18.334997 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-09c8ac0e-57c2-4fb0-8964-ef416f25839a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:18.335601 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-09c8ac0e-57c2-4fb0-8964-ef416f25839a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:18.342066 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-09c8ac0e-57c2-4fb0-8964-ef416f25839a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:18.342544 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-09c8ac0e-57c2-4fb0-8964-ef416f25839a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:18.343001 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-09c8ac0e-57c2-4fb0-8964-ef416f25839a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:18.343684 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-09c8ac0e-57c2-4fb0-8964-ef416f25839a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:18.344153 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-09c8ac0e-57c2-4fb0-8964-ef416f25839a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:18.344574 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-09c8ac0e-57c2-4fb0-8964-ef416f25839a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:18.468462 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-09c8ac0e-57c2-4fb0-8964-ef416f25839a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:18.476451 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-09c8ac0e-57c2-4fb0-8964-ef416f25839a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:18.477898 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-09c8ac0e-57c2-4fb0-8964-ef416f25839a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:18.479068 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-09c8ac0e-57c2-4fb0-8964-ef416f25839a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1724 microversion: 2.20 time: 0.149374 Oct 26 11:24:18.479628 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 330/643] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:24:18 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 11:24:18.770117 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-71efd313-bc39-4821-8633-2df55ab300ad tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:18.770844 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-71efd313-bc39-4821-8633-2df55ab300ad tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:18.777468 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-71efd313-bc39-4821-8633-2df55ab300ad tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:18.777955 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-71efd313-bc39-4821-8633-2df55ab300ad tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:18.778400 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-71efd313-bc39-4821-8633-2df55ab300ad tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:18.779122 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-71efd313-bc39-4821-8633-2df55ab300ad tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:18.779586 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-71efd313-bc39-4821-8633-2df55ab300ad tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:18.780014 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-71efd313-bc39-4821-8633-2df55ab300ad tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:18.912931 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-71efd313-bc39-4821-8633-2df55ab300ad tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:18.920541 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-71efd313-bc39-4821-8633-2df55ab300ad tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1569 microversion: 2.1 time: 0.154697 Oct 26 11:24:18.921195 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 314/644] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:18 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:18.926981 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-6f9026de-35eb-4d07-8648-362d3212621a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:18.927588 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-6f9026de-35eb-4d07-8648-362d3212621a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:18.933708 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6f9026de-35eb-4d07-8648-362d3212621a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:18.934214 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6f9026de-35eb-4d07-8648-362d3212621a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:18.934645 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6f9026de-35eb-4d07-8648-362d3212621a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:18.935348 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6f9026de-35eb-4d07-8648-362d3212621a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:18.935794 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6f9026de-35eb-4d07-8648-362d3212621a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:18.936205 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6f9026de-35eb-4d07-8648-362d3212621a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:18.943546 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-bb0d10b5-de0e-4e18-8638-b2e0fc9935c5 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:24:18.944146 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-bb0d10b5-de0e-4e18-8638-b2e0fc9935c5 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:18.949973 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bb0d10b5-de0e-4e18-8638-b2e0fc9935c5 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:18.950460 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bb0d10b5-de0e-4e18-8638-b2e0fc9935c5 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:18.950927 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bb0d10b5-de0e-4e18-8638-b2e0fc9935c5 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:18.951624 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bb0d10b5-de0e-4e18-8638-b2e0fc9935c5 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:18.952106 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bb0d10b5-de0e-4e18-8638-b2e0fc9935c5 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:18.952532 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bb0d10b5-de0e-4e18-8638-b2e0fc9935c5 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:18.980576 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-bb0d10b5-de0e-4e18-8638-b2e0fc9935c5 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119305) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 26 11:24:19.066042 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-6f9026de-35eb-4d07-8648-362d3212621a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:19.073694 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-6f9026de-35eb-4d07-8648-362d3212621a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89" status: 200 len: 1367 microversion: 2.1 time: 0.151028 Oct 26 11:24:19.074258 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 331/645] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:18 2022] GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:19.228180 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-bb0d10b5-de0e-4e18-8638-b2e0fc9935c5 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "POST /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991/action" status: 202 len: 0 microversion: 2.1 time: 0.289041 Oct 26 11:24:19.228778 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 315/646] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Oct 26 11:24:18 2022] POST /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 11:24:19.236863 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-61717251-e1fe-4fb8-a6f7-6c56acec906e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:19.237475 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-61717251-e1fe-4fb8-a6f7-6c56acec906e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:19.244076 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-61717251-e1fe-4fb8-a6f7-6c56acec906e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:19.244561 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-61717251-e1fe-4fb8-a6f7-6c56acec906e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:19.244998 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-61717251-e1fe-4fb8-a6f7-6c56acec906e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:19.245839 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-61717251-e1fe-4fb8-a6f7-6c56acec906e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:19.246297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-61717251-e1fe-4fb8-a6f7-6c56acec906e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:19.246720 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-61717251-e1fe-4fb8-a6f7-6c56acec906e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:19.375199 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-61717251-e1fe-4fb8-a6f7-6c56acec906e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:19.383478 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-61717251-e1fe-4fb8-a6f7-6c56acec906e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1577 microversion: 2.1 time: 0.150352 Oct 26 11:24:19.384060 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 332/647] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:19 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:19.504699 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-9891e787-1f89-47e2-bf35-7a207781579b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:19.505317 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-9891e787-1f89-47e2-bf35-7a207781579b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:19.511536 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9891e787-1f89-47e2-bf35-7a207781579b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:19.512107 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9891e787-1f89-47e2-bf35-7a207781579b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:19.512642 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9891e787-1f89-47e2-bf35-7a207781579b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:19.513396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9891e787-1f89-47e2-bf35-7a207781579b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:19.513983 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9891e787-1f89-47e2-bf35-7a207781579b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:19.514470 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9891e787-1f89-47e2-bf35-7a207781579b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:19.643397 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-9891e787-1f89-47e2-bf35-7a207781579b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:19.655665 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-9891e787-1f89-47e2-bf35-7a207781579b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:19.655665 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-9891e787-1f89-47e2-bf35-7a207781579b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:19.655665 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-9891e787-1f89-47e2-bf35-7a207781579b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1724 microversion: 2.20 time: 0.154849 Oct 26 11:24:19.655995 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 316/648] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:24:19 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:24:20.096562 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-dcfb5b8d-c073-4bc0-a8b8-6bf863b85111 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:20.097173 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-dcfb5b8d-c073-4bc0-a8b8-6bf863b85111 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:20.104017 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dcfb5b8d-c073-4bc0-a8b8-6bf863b85111 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:20.104543 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dcfb5b8d-c073-4bc0-a8b8-6bf863b85111 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:20.105008 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dcfb5b8d-c073-4bc0-a8b8-6bf863b85111 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:20.105711 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dcfb5b8d-c073-4bc0-a8b8-6bf863b85111 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:20.106168 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dcfb5b8d-c073-4bc0-a8b8-6bf863b85111 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:20.106637 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dcfb5b8d-c073-4bc0-a8b8-6bf863b85111 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:20.231382 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-dcfb5b8d-c073-4bc0-a8b8-6bf863b85111 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:20.239474 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-dcfb5b8d-c073-4bc0-a8b8-6bf863b85111 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89" status: 200 len: 1557 microversion: 2.1 time: 0.146820 Oct 26 11:24:20.240030 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 333/649] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:20 2022] GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:20.262166 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-729e1fb1-88fe-494e-aa1b-109f9d6aec7d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:20.262676 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-729e1fb1-88fe-494e-aa1b-109f9d6aec7d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:20.269098 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-729e1fb1-88fe-494e-aa1b-109f9d6aec7d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:20.269580 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-729e1fb1-88fe-494e-aa1b-109f9d6aec7d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:20.270013 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-729e1fb1-88fe-494e-aa1b-109f9d6aec7d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:20.270692 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-729e1fb1-88fe-494e-aa1b-109f9d6aec7d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:20.271165 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-729e1fb1-88fe-494e-aa1b-109f9d6aec7d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:20.271585 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-729e1fb1-88fe-494e-aa1b-109f9d6aec7d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:20.348834 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-729e1fb1-88fe-494e-aa1b-109f9d6aec7d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090582 Oct 26 11:24:20.349436 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 317/650] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Oct 26 11:24:20 2022] GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:24:20.408910 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-ec92d297-7546-4325-be11-ffc5baa2d5ea tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:20.409592 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-ec92d297-7546-4325-be11-ffc5baa2d5ea tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:20.413194 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-edf46083-c823-4000-9ec1-dba41a6600ba req-5049ab0b-d312-4e95-b224-0a8afd3e1a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4b20a22-cb3b-4fb4-8b69-3b626cd6d991", "name": "network-vif-unplugged", "status": "completed", "tag": "de570ff5-446d-40b7-add4-d927b658a166"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:24:20.416286 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ec92d297-7546-4325-be11-ffc5baa2d5ea tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:20.416773 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ec92d297-7546-4325-be11-ffc5baa2d5ea tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:20.417390 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ec92d297-7546-4325-be11-ffc5baa2d5ea tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:20.418366 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ec92d297-7546-4325-be11-ffc5baa2d5ea tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:20.419184 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ec92d297-7546-4325-be11-ffc5baa2d5ea tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:20.419773 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ec92d297-7546-4325-be11-ffc5baa2d5ea tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:20.426337 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-edf46083-c823-4000-9ec1-dba41a6600ba req-5049ab0b-d312-4e95-b224-0a8afd3e1a3c service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:20.427238 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-edf46083-c823-4000-9ec1-dba41a6600ba req-5049ab0b-d312-4e95-b224-0a8afd3e1a3c service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:20.427798 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-edf46083-c823-4000-9ec1-dba41a6600ba req-5049ab0b-d312-4e95-b224-0a8afd3e1a3c service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:20.432036 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:24:20.440177 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-edf46083-c823-4000-9ec1-dba41a6600ba req-5049ab0b-d312-4e95-b224-0a8afd3e1a3c service nova] Creating event network-vif-unplugged:de570ff5-446d-40b7-add4-d927b658a166 for instance e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 on hv-cinder-81558 Oct 26 11:24:20.446187 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-edf46083-c823-4000-9ec1-dba41a6600ba req-5049ab0b-d312-4e95-b224-0a8afd3e1a3c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037201 Oct 26 11:24:20.446872 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 318/651] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:24:20.681354 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-f1bacbf8-a584-48b7-a7b3-8719c88344ec tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:20.682475 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-f1bacbf8-a584-48b7-a7b3-8719c88344ec tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:20.689922 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f1bacbf8-a584-48b7-a7b3-8719c88344ec tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:20.690800 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f1bacbf8-a584-48b7-a7b3-8719c88344ec tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:20.695658 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f1bacbf8-a584-48b7-a7b3-8719c88344ec tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:20.695658 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f1bacbf8-a584-48b7-a7b3-8719c88344ec tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:20.695658 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f1bacbf8-a584-48b7-a7b3-8719c88344ec tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:20.695658 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f1bacbf8-a584-48b7-a7b3-8719c88344ec tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:20.799985 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ec92d297-7546-4325-be11-ffc5baa2d5ea tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:20.808647 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-ec92d297-7546-4325-be11-ffc5baa2d5ea tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1577 microversion: 2.1 time: 0.405483 Oct 26 11:24:20.809243 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 334/652] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:20 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1577 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:20.991923 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-f1bacbf8-a584-48b7-a7b3-8719c88344ec tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:21.000790 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-f1bacbf8-a584-48b7-a7b3-8719c88344ec tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:21.002215 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-f1bacbf8-a584-48b7-a7b3-8719c88344ec tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:21.003544 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-f1bacbf8-a584-48b7-a7b3-8719c88344ec tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1724 microversion: 2.20 time: 0.326536 Oct 26 11:24:21.006618 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 319/653] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:24:20 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1724 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 11:24:21.833656 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-d7eb63b4-caa7-4b62-bf53-dc7005080d5a req-5c5e6506-dd36-4bfa-ab7b-e142d6627a18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be2a7ec3-e66b-477d-99da-8d730066cf89", "tag": "e22707f0-8877-4f00-ab3e-d053cdf8c8fa"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:24:21.834315 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-6bdf4580-dce8-44ea-9fbb-5b4e4a616782 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:21.841131 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-6bdf4580-dce8-44ea-9fbb-5b4e4a616782 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:21.848053 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6bdf4580-dce8-44ea-9fbb-5b4e4a616782 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:21.848622 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6bdf4580-dce8-44ea-9fbb-5b4e4a616782 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:21.849280 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6bdf4580-dce8-44ea-9fbb-5b4e4a616782 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:21.850044 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6bdf4580-dce8-44ea-9fbb-5b4e4a616782 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:21.850594 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6bdf4580-dce8-44ea-9fbb-5b4e4a616782 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:21.851107 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6bdf4580-dce8-44ea-9fbb-5b4e4a616782 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:21.855333 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-d7eb63b4-caa7-4b62-bf53-dc7005080d5a req-5c5e6506-dd36-4bfa-ab7b-e142d6627a18 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:21.858340 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-d7eb63b4-caa7-4b62-bf53-dc7005080d5a req-5c5e6506-dd36-4bfa-ab7b-e142d6627a18 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:21.860695 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-d7eb63b4-caa7-4b62-bf53-dc7005080d5a req-5c5e6506-dd36-4bfa-ab7b-e142d6627a18 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:21.879453 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-d7eb63b4-caa7-4b62-bf53-dc7005080d5a req-5c5e6506-dd36-4bfa-ab7b-e142d6627a18 service nova] Creating event network-changed:e22707f0-8877-4f00-ab3e-d053cdf8c8fa for instance be2a7ec3-e66b-477d-99da-8d730066cf89 on hv-cinder-81558 Oct 26 11:24:21.887611 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-d7eb63b4-caa7-4b62-bf53-dc7005080d5a req-5c5e6506-dd36-4bfa-ab7b-e142d6627a18 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057369 Oct 26 11:24:21.893075 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 320/654] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:24:22.032604 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-c2e33bf8-5a82-4a11-b5d8-af0eda4ac3c4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:22.033433 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-c2e33bf8-5a82-4a11-b5d8-af0eda4ac3c4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:22.040786 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c2e33bf8-5a82-4a11-b5d8-af0eda4ac3c4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:22.041676 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c2e33bf8-5a82-4a11-b5d8-af0eda4ac3c4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:22.042344 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c2e33bf8-5a82-4a11-b5d8-af0eda4ac3c4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:22.043372 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c2e33bf8-5a82-4a11-b5d8-af0eda4ac3c4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:22.044049 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c2e33bf8-5a82-4a11-b5d8-af0eda4ac3c4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:22.051568 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c2e33bf8-5a82-4a11-b5d8-af0eda4ac3c4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:22.137820 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-6bdf4580-dce8-44ea-9fbb-5b4e4a616782 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:22.151757 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-6bdf4580-dce8-44ea-9fbb-5b4e4a616782 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1519 microversion: 2.1 time: 0.322532 Oct 26 11:24:22.153928 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 335/655] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:21 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1519 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:22.350239 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-c2e33bf8-5a82-4a11-b5d8-af0eda4ac3c4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:22.361079 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-c2e33bf8-5a82-4a11-b5d8-af0eda4ac3c4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:22.363836 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-c2e33bf8-5a82-4a11-b5d8-af0eda4ac3c4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:22.365354 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-c2e33bf8-5a82-4a11-b5d8-af0eda4ac3c4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1657 microversion: 2.20 time: 0.337169 Oct 26 11:24:22.366510 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 321/656] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:24:22 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1657 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:24:23.181693 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-70dcb7d1-b9c3-4d56-8ae4-13553242ebf8 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:23.182314 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-70dcb7d1-b9c3-4d56-8ae4-13553242ebf8 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:23.188875 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-70dcb7d1-b9c3-4d56-8ae4-13553242ebf8 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:23.189361 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-70dcb7d1-b9c3-4d56-8ae4-13553242ebf8 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:23.189876 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-70dcb7d1-b9c3-4d56-8ae4-13553242ebf8 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:23.190571 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-70dcb7d1-b9c3-4d56-8ae4-13553242ebf8 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:23.191115 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-70dcb7d1-b9c3-4d56-8ae4-13553242ebf8 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:23.191536 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-70dcb7d1-b9c3-4d56-8ae4-13553242ebf8 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:23.328752 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-70dcb7d1-b9c3-4d56-8ae4-13553242ebf8 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:23.336616 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-70dcb7d1-b9c3-4d56-8ae4-13553242ebf8 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1519 microversion: 2.1 time: 0.158970 Oct 26 11:24:23.337354 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 336/657] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:23 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:23.391197 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-79e94c99-11c5-4e99-8629-e0842443f607 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:23.391807 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-79e94c99-11c5-4e99-8629-e0842443f607 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:23.399739 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-79e94c99-11c5-4e99-8629-e0842443f607 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:23.400230 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-79e94c99-11c5-4e99-8629-e0842443f607 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:23.400849 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-79e94c99-11c5-4e99-8629-e0842443f607 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:23.401968 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-79e94c99-11c5-4e99-8629-e0842443f607 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:23.402586 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-79e94c99-11c5-4e99-8629-e0842443f607 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:23.403194 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-79e94c99-11c5-4e99-8629-e0842443f607 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:23.436278 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-79e94c99-11c5-4e99-8629-e0842443f607 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:23.436782 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-79e94c99-11c5-4e99-8629-e0842443f607 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:23.437217 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-79e94c99-11c5-4e99-8629-e0842443f607 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:23.437694 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.objects.instance [None req-79e94c99-11c5-4e99-8629-e0842443f607 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lazy-loading 'fault' on Instance uuid 2821a8ff-1cb6-43c5-9968-1c13e293ad1a {{(pid=119305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:24:23.488062 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-79e94c99-11c5-4e99-8629-e0842443f607 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:23.496604 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-79e94c99-11c5-4e99-8629-e0842443f607 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:23.498088 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-79e94c99-11c5-4e99-8629-e0842443f607 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:23.499470 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-79e94c99-11c5-4e99-8629-e0842443f607 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 200 len: 1371 microversion: 2.20 time: 0.112266 Oct 26 11:24:23.500038 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 322/658] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:24:23 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 1371 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:24:23.917763 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-b5f7e7a5-240e-480a-b2e4-6fcfb83addf5 req-5afcb598-4409-45fd-a9c6-2dfc7dabb714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2821a8ff-1cb6-43c5-9968-1c13e293ad1a", "name": "network-vif-deleted", "tag": "6cd2d732-48e8-4aca-ac57-8f769619a1f1"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:24:23.928091 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-b5f7e7a5-240e-480a-b2e4-6fcfb83addf5 req-5afcb598-4409-45fd-a9c6-2dfc7dabb714 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:23.928562 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-b5f7e7a5-240e-480a-b2e4-6fcfb83addf5 req-5afcb598-4409-45fd-a9c6-2dfc7dabb714 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:23.928983 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-b5f7e7a5-240e-480a-b2e4-6fcfb83addf5 req-5afcb598-4409-45fd-a9c6-2dfc7dabb714 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:23.939470 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-b5f7e7a5-240e-480a-b2e4-6fcfb83addf5 req-5afcb598-4409-45fd-a9c6-2dfc7dabb714 service nova] Creating event network-vif-deleted:6cd2d732-48e8-4aca-ac57-8f769619a1f1 for instance 2821a8ff-1cb6-43c5-9968-1c13e293ad1a on hv-cinder-81558 Oct 26 11:24:23.945130 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-b5f7e7a5-240e-480a-b2e4-6fcfb83addf5 req-5afcb598-4409-45fd-a9c6-2dfc7dabb714 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031046 Oct 26 11:24:23.945692 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 337/659] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:24:24.359706 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-8ffbb776-a812-4ec3-958a-8ba643d9a7fd tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:24.360322 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-8ffbb776-a812-4ec3-958a-8ba643d9a7fd tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:24.367597 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8ffbb776-a812-4ec3-958a-8ba643d9a7fd tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:24.368087 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8ffbb776-a812-4ec3-958a-8ba643d9a7fd tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:24.368533 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8ffbb776-a812-4ec3-958a-8ba643d9a7fd tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:24.369232 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8ffbb776-a812-4ec3-958a-8ba643d9a7fd tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:24.369689 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8ffbb776-a812-4ec3-958a-8ba643d9a7fd tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:24.370117 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8ffbb776-a812-4ec3-958a-8ba643d9a7fd tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:24.502557 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-8ffbb776-a812-4ec3-958a-8ba643d9a7fd tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:24.510439 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-8ffbb776-a812-4ec3-958a-8ba643d9a7fd tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1575 microversion: 2.1 time: 0.154722 Oct 26 11:24:24.511047 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 323/660] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:24 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:24.529081 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-5caa8497-cf74-41d7-9b74-61a69ef06dc8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:24.529801 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-5caa8497-cf74-41d7-9b74-61a69ef06dc8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:24.536322 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5caa8497-cf74-41d7-9b74-61a69ef06dc8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:24.536806 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5caa8497-cf74-41d7-9b74-61a69ef06dc8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:24.537237 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5caa8497-cf74-41d7-9b74-61a69ef06dc8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:24.537919 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5caa8497-cf74-41d7-9b74-61a69ef06dc8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:24.538369 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5caa8497-cf74-41d7-9b74-61a69ef06dc8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:24.538785 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5caa8497-cf74-41d7-9b74-61a69ef06dc8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:24.553687 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.wsgi [None req-5caa8497-cf74-41d7-9b74-61a69ef06dc8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] HTTP exception thrown: Instance 2821a8ff-1cb6-43c5-9968-1c13e293ad1a could not be found. Oct 26 11:24:24.555450 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-5caa8497-cf74-41d7-9b74-61a69ef06dc8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Request method failure captured: Oct 26 11:24:24.555450 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: request: GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a HTTP/1.1 Oct 26 11:24:24.555450 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept: application/json Oct 26 11:24:24.555450 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept-Encoding: identity Oct 26 11:24:24.555450 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Connection: close Oct 26 11:24:24.555450 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Length: 0 Oct 26 11:24:24.555450 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Type: application/json Oct 26 11:24:24.555450 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Host: 10.222.0.42 Oct 26 11:24:24.555450 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Openstack-System-Scope: None Oct 26 11:24:24.555450 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: User-Agent: python-urllib3/1.26.12 Oct 26 11:24:24.555450 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Auth-Token: gAAAAABjWRdv0aSpSzvPcVWphOtqPXyKdasF2RVRrPNaRgWwBP0LqdMWrJ85_uRmo9VD_X4IUYNpvQRCl3ABu8z9MPkgOos9-Ibll7dsuwae0BX7ur_YlLAoksXsMIHdBaQkRkeWoyQelNp3i6Eh-ZJgcRTHM-z5nAi4rzAFiebDUqVJTNEViN8 Oct 26 11:24:24.555450 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Id: None Oct 26 11:24:24.555450 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Name: None Oct 26 11:24:24.555450 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Identity-Status: Confirmed Oct 26 11:24:24.555450 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Is-Admin-Project: True Oct 26 11:24:24.555450 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Openstack-Nova-Api-Version: 2.20 Oct 26 11:24:24.555450 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Id: default Oct 26 11:24:24.555450 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Name: Default Oct 26 11:24:24.555450 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Id: ab29bf15969d46da9670efa2b52e6676 Oct 26 11:24:24.555450 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-531427414 Oct 26 11:24:24.555450 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Role: member,reader Oct 26 11:24:24.555450 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Roles: member,reader Oct 26 11:24:24.557007 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ab29bf15969d46da9670efa2b52e6676", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab29bf15969d46da9670efa2b52e6676"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ab29bf15969d46da9670efa2b52e6676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab29bf15969d46da9670efa2b52e6676"}]}] Oct 26 11:24:24.557007 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant: tempest-AttachVolumeShelveTestJSON-531427414 Oct 26 11:24:24.557007 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Id: ab29bf15969d46da9670efa2b52e6676 Oct 26 11:24:24.557007 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-531427414 Oct 26 11:24:24.557007 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User: tempest-AttachVolumeShelveTestJSON-531427414-project Oct 26 11:24:24.557007 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Id: default Oct 26 11:24:24.557007 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Name: Default Oct 26 11:24:24.557007 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Id: 41276c93e476436791b89ab8a0d4537d Oct 26 11:24:24.557007 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Name: tempest-AttachVolumeShelveTestJSON-531427414-project Oct 26 11:24:24.557007 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: method: > Oct 26 11:24:24.557007 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: exception: Instance 2821a8ff-1cb6-43c5-9968-1c13e293ad1a could not be found. Oct 26 11:24:24.557007 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: action_args: {'id': '2821a8ff-1cb6-43c5-9968-1c13e293ad1a'} Oct 26 11:24:24.557844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:24:24.557844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:24:24.557844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:24:24.557844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:24:24.557844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:24:24.557844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:24:24.557844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:24:24.557844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:24:24.557844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:24:24.557844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:24:24.557844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2821a8ff-1cb6-43c5-9968-1c13e293ad1a could not be found. Oct 26 11:24:24.557844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:24:24.557844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:24:24.557844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:24:24.557844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:24:24.557844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:24:24.557844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:24:24.557844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:24:24.557844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:24:24.557844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:24:24.559164 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:24:24.559164 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 11:24:24.559164 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 11:24:24.559164 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:24:24.559164 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:24:24.559164 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:24:24.559164 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:24:24.559164 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2821a8ff-1cb6-43c5-9968-1c13e293ad1a could not be found. Oct 26 11:24:24.559164 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:24:24.559164 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:24:24.559164 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:24:24.559164 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:24:24.559164 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:24:24.559164 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:24:24.559164 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:24:24.559164 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:24:24.559164 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2821a8ff-1cb6-43c5-9968-1c13e293ad1a could not be found. Oct 26 11:24:24.559164 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:24:24.560322 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-5caa8497-cf74-41d7-9b74-61a69ef06dc8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Returning 404 to user: Instance 2821a8ff-1cb6-43c5-9968-1c13e293ad1a could not be found. {{(pid=119306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:24:24.560322 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-5caa8497-cf74-41d7-9b74-61a69ef06dc8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 404 len: 111 microversion: 2.20 time: 0.032823 Oct 26 11:24:24.560322 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 338/661] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:24:24 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 11:24:24.565719 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-09c68f2b-13b2-4488-a362-ece18053c3a0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '.version_select at 0x7f6b93822430>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:24.633114 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-09c68f2b-13b2-4488-a362-ece18053c3a0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-283898050" status: 204 len: 0 microversion: 2.20 time: 0.071153 Oct 26 11:24:24.640604 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 324/662] 10.222.0.42 () {60 vars in 1259 bytes} [Wed Oct 26 11:24:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-283898050 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 26 11:24:25.369773 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-eda62634-66d8-41c4-99c5-f77d8d396593 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Action: 'create', calling method: .version_select at 0x7f6b9383e8b0>, body: {"keypair": {"name": "tempest-keypair-1790893251", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEmJYrwEI4J6kT7CAR/ytkHCBFHh3apgc/FeD3pFAr7P1Ze0VaSRbcWZQruMyJYRcD8v+LDXSNQwbNlzrkXbNiTxYzSAKWkZYR1e2k298F0kdF+E/yGbEl3vrXV02mowg=="}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:24:25.385629 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-eda62634-66d8-41c4-99c5-f77d8d396593 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Getting quotas for project ab29bf15969d46da9670efa2b52e6676. Resources: {'key_pairs'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:24:25.389410 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-eda62634-66d8-41c4-99c5-f77d8d396593 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Getting quotas for user 41276c93e476436791b89ab8a0d4537d and project ab29bf15969d46da9670efa2b52e6676. Resources: {'key_pairs'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:24:25.460869 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-eda62634-66d8-41c4-99c5-f77d8d396593 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.095018 Oct 26 11:24:25.461457 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 339/663] 10.222.0.42 () {62 vars in 1200 bytes} [Wed Oct 26 11:24:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 96 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 26 11:24:25.533989 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-c6da3afa-dfe2-4481-984f-472fee340dd3 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:25.534636 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-c6da3afa-dfe2-4481-984f-472fee340dd3 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:25.541505 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c6da3afa-dfe2-4481-984f-472fee340dd3 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:25.542136 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c6da3afa-dfe2-4481-984f-472fee340dd3 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:25.542575 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c6da3afa-dfe2-4481-984f-472fee340dd3 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:25.543329 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c6da3afa-dfe2-4481-984f-472fee340dd3 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:25.543739 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c6da3afa-dfe2-4481-984f-472fee340dd3 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:25.544157 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c6da3afa-dfe2-4481-984f-472fee340dd3 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:25.547513 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-b499cba7-66da-468e-afda-fab048371fcf tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:25.548250 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-b499cba7-66da-468e-afda-fab048371fcf tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:25.554744 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b499cba7-66da-468e-afda-fab048371fcf tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:25.555268 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b499cba7-66da-468e-afda-fab048371fcf tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:25.555703 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b499cba7-66da-468e-afda-fab048371fcf tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:25.556399 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b499cba7-66da-468e-afda-fab048371fcf tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:25.557030 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b499cba7-66da-468e-afda-fab048371fcf tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:25.557780 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b499cba7-66da-468e-afda-fab048371fcf tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:25.584096 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-b499cba7-66da-468e-afda-fab048371fcf tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Going to try to terminate instance {{(pid=119306) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 11:24:25.705435 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-c6da3afa-dfe2-4481-984f-472fee340dd3 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:25.713178 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-c6da3afa-dfe2-4481-984f-472fee340dd3 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1575 microversion: 2.1 time: 0.183576 Oct 26 11:24:25.714806 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 325/664] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:25 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1575 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:25.837648 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-b499cba7-66da-468e-afda-fab048371fcf tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 204 len: 0 microversion: 2.1 time: 0.294259 Oct 26 11:24:25.838315 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 340/665] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Oct 26 11:24:25 2022] DELETE /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 11:24:25.849391 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-9792af64-7049-4a7e-8687-4f052fd562a5 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:25.850008 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-9792af64-7049-4a7e-8687-4f052fd562a5 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:25.856339 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9792af64-7049-4a7e-8687-4f052fd562a5 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:25.856517 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9792af64-7049-4a7e-8687-4f052fd562a5 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:25.856955 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9792af64-7049-4a7e-8687-4f052fd562a5 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:25.857670 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9792af64-7049-4a7e-8687-4f052fd562a5 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:25.858175 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9792af64-7049-4a7e-8687-4f052fd562a5 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:25.858598 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9792af64-7049-4a7e-8687-4f052fd562a5 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:26.031003 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-9792af64-7049-4a7e-8687-4f052fd562a5 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:26.038807 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-9792af64-7049-4a7e-8687-4f052fd562a5 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1579 microversion: 2.1 time: 0.193414 Oct 26 11:24:26.039400 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 326/666] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:25 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1579 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:26.737169 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-43e8bc8d-385f-4c44-93a9-df0ee18e71c5 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:26.738608 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-43e8bc8d-385f-4c44-93a9-df0ee18e71c5 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:26.746104 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-43e8bc8d-385f-4c44-93a9-df0ee18e71c5 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:26.746675 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-43e8bc8d-385f-4c44-93a9-df0ee18e71c5 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:26.747474 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-43e8bc8d-385f-4c44-93a9-df0ee18e71c5 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:26.747877 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-43e8bc8d-385f-4c44-93a9-df0ee18e71c5 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:26.748324 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-43e8bc8d-385f-4c44-93a9-df0ee18e71c5 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:26.748871 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-43e8bc8d-385f-4c44-93a9-df0ee18e71c5 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:26.953096 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-43e8bc8d-385f-4c44-93a9-df0ee18e71c5 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:26.960653 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-43e8bc8d-385f-4c44-93a9-df0ee18e71c5 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1575 microversion: 2.1 time: 0.227839 Oct 26 11:24:26.961222 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 341/667] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:26 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1575 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:27.061954 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-534c22cc-05ae-41b0-8ca4-96c6c438498e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:27.062557 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-534c22cc-05ae-41b0-8ca4-96c6c438498e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:27.069286 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-534c22cc-05ae-41b0-8ca4-96c6c438498e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:27.069792 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-534c22cc-05ae-41b0-8ca4-96c6c438498e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:27.070256 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-534c22cc-05ae-41b0-8ca4-96c6c438498e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:27.070974 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-534c22cc-05ae-41b0-8ca4-96c6c438498e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:27.071410 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-534c22cc-05ae-41b0-8ca4-96c6c438498e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:27.071873 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-534c22cc-05ae-41b0-8ca4-96c6c438498e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:27.205044 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-534c22cc-05ae-41b0-8ca4-96c6c438498e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:27.213070 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-534c22cc-05ae-41b0-8ca4-96c6c438498e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1579 microversion: 2.1 time: 0.155223 Oct 26 11:24:27.213746 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 327/668] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:27 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1579 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:27.693493 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e908386a-a5be-43ea-b3e5-36ff9923d32a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1903195968", "imageRef": "ed8b5733-339c-4fa7-9767-abef514cb9f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8a84e861-89f8-4687-9444-98b50729a58f"}], "security_groups": [{"name": "tempest-securitygroup--86172091"}], "key_name": "tempest-keypair-1790893251", "user_data": "}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:24:27.798560 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.network.neutron [None req-e908386a-a5be-43ea-b3e5-36ff9923d32a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] validate_networks() for [('8a84e861-89f8-4687-9444-98b50729a58f', None, None, None, None, None)] {{(pid=119306) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 11:24:27.983641 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-0a12c459-5cc2-41f7-863b-96179b601b5c tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:27.984247 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-0a12c459-5cc2-41f7-863b-96179b601b5c tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:27.990580 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0a12c459-5cc2-41f7-863b-96179b601b5c tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:27.991092 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0a12c459-5cc2-41f7-863b-96179b601b5c tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:27.991527 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0a12c459-5cc2-41f7-863b-96179b601b5c tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:27.992218 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0a12c459-5cc2-41f7-863b-96179b601b5c tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:27.992667 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0a12c459-5cc2-41f7-863b-96179b601b5c tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:27.993085 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0a12c459-5cc2-41f7-863b-96179b601b5c tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:28.127912 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-0a12c459-5cc2-41f7-863b-96179b601b5c tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:28.136785 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-0a12c459-5cc2-41f7-863b-96179b601b5c tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1575 microversion: 2.1 time: 0.156328 Oct 26 11:24:28.137376 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 328/669] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:27 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:24:28.238043 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-8308e20e-4f6b-45a9-8b01-d0cf0f2ac1b4 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:28.238577 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-8308e20e-4f6b-45a9-8b01-d0cf0f2ac1b4 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:28.244607 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8308e20e-4f6b-45a9-8b01-d0cf0f2ac1b4 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:28.245096 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8308e20e-4f6b-45a9-8b01-d0cf0f2ac1b4 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:28.245539 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8308e20e-4f6b-45a9-8b01-d0cf0f2ac1b4 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:28.246239 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8308e20e-4f6b-45a9-8b01-d0cf0f2ac1b4 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:28.246698 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8308e20e-4f6b-45a9-8b01-d0cf0f2ac1b4 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:28.247160 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8308e20e-4f6b-45a9-8b01-d0cf0f2ac1b4 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:28.378672 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-8308e20e-4f6b-45a9-8b01-d0cf0f2ac1b4 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:28.386831 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-8308e20e-4f6b-45a9-8b01-d0cf0f2ac1b4 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1579 microversion: 2.1 time: 0.153343 Oct 26 11:24:28.391004 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 329/670] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:28 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1579 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:24:28.560956 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-e908386a-a5be-43ea-b3e5-36ff9923d32a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Flavor limits 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 11:24:28.561462 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-e908386a-a5be-43ea-b3e5-36ff9923d32a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Image limits 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 11:24:28.562113 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-e908386a-a5be-43ea-b3e5-36ff9923d32a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Flavor pref 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 11:24:28.562716 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-e908386a-a5be-43ea-b3e5-36ff9923d32a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Image pref 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 11:24:28.563203 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-e908386a-a5be-43ea-b3e5-36ff9923d32a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 11:24:28.572640 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e908386a-a5be-43ea-b3e5-36ff9923d32a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:28.573120 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e908386a-a5be-43ea-b3e5-36ff9923d32a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:28.573546 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e908386a-a5be-43ea-b3e5-36ff9923d32a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:28.574259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e908386a-a5be-43ea-b3e5-36ff9923d32a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:28.574750 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e908386a-a5be-43ea-b3e5-36ff9923d32a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:28.575173 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e908386a-a5be-43ea-b3e5-36ff9923d32a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:28.591567 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-e908386a-a5be-43ea-b3e5-36ff9923d32a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Getting quotas for project ab29bf15969d46da9670efa2b52e6676. Resources: {'cores', 'instances', 'ram'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:24:28.595652 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-e908386a-a5be-43ea-b3e5-36ff9923d32a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Getting quotas for user 41276c93e476436791b89ab8a0d4537d and project ab29bf15969d46da9670efa2b52e6676. Resources: {'cores', 'instances', 'ram'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:24:28.606771 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-e908386a-a5be-43ea-b3e5-36ff9923d32a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Going to run 1 instances... {{(pid=119306) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 11:24:28.609100 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-e908386a-a5be-43ea-b3e5-36ff9923d32a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed8b5733-339c-4fa7-9767-abef514cb9f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119306) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 11:24:28.716864 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e908386a-a5be-43ea-b3e5-36ff9923d32a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [3257f1c7-2c88-4858-ae12-6b713bf0e919] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 11:24:29.160984 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-82166893-de16-47fa-a97b-4d19f106dc59 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:29.161598 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-82166893-de16-47fa-a97b-4d19f106dc59 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:29.168629 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-82166893-de16-47fa-a97b-4d19f106dc59 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:29.169334 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-82166893-de16-47fa-a97b-4d19f106dc59 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:29.169917 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-82166893-de16-47fa-a97b-4d19f106dc59 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:29.170786 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-82166893-de16-47fa-a97b-4d19f106dc59 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:29.171544 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-82166893-de16-47fa-a97b-4d19f106dc59 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:29.172219 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-82166893-de16-47fa-a97b-4d19f106dc59 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:29.320035 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-82166893-de16-47fa-a97b-4d19f106dc59 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:29.328069 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-82166893-de16-47fa-a97b-4d19f106dc59 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1575 microversion: 2.1 time: 0.171110 Oct 26 11:24:29.330869 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 330/671] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:29 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:24:29.395860 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-15c2947c-3b8a-4513-881f-9e763dff50e7 req-4a35008d-9155-4a0e-b87b-b31ee784abd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f64d1d1-56f2-4ec0-b93a-faceb3411d40", "name": "network-vif-deleted", "tag": "f2bbf28a-4a02-46b3-af42-40afd907a949"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:24:29.405925 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-15c2947c-3b8a-4513-881f-9e763dff50e7 req-4a35008d-9155-4a0e-b87b-b31ee784abd7 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:29.406404 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-15c2947c-3b8a-4513-881f-9e763dff50e7 req-4a35008d-9155-4a0e-b87b-b31ee784abd7 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:29.406879 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-15c2947c-3b8a-4513-881f-9e763dff50e7 req-4a35008d-9155-4a0e-b87b-b31ee784abd7 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:29.418315 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-15c2947c-3b8a-4513-881f-9e763dff50e7 req-4a35008d-9155-4a0e-b87b-b31ee784abd7 service nova] Creating event network-vif-deleted:f2bbf28a-4a02-46b3-af42-40afd907a949 for instance 1f64d1d1-56f2-4ec0-b93a-faceb3411d40 on hv-cinder-81558 Oct 26 11:24:29.423372 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-15c2947c-3b8a-4513-881f-9e763dff50e7 req-4a35008d-9155-4a0e-b87b-b31ee784abd7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093368 Oct 26 11:24:29.424058 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 331/672] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:24:29.430079 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-e4a0369a-24a7-4ff6-907a-76ecdec45066 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:29.430893 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-e4a0369a-24a7-4ff6-907a-76ecdec45066 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:29.437109 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e4a0369a-24a7-4ff6-907a-76ecdec45066 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:29.438638 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e4a0369a-24a7-4ff6-907a-76ecdec45066 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:29.438638 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e4a0369a-24a7-4ff6-907a-76ecdec45066 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:29.438875 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e4a0369a-24a7-4ff6-907a-76ecdec45066 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:29.439272 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e4a0369a-24a7-4ff6-907a-76ecdec45066 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:29.439701 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e4a0369a-24a7-4ff6-907a-76ecdec45066 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:29.511117 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-e4a0369a-24a7-4ff6-907a-76ecdec45066 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:29.519310 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-e4a0369a-24a7-4ff6-907a-76ecdec45066 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1226 microversion: 2.1 time: 0.093496 Oct 26 11:24:29.519885 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 332/673] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:29 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:29.730290 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO oslo.messaging._drivers.impl_rabbit [None req-e908386a-a5be-43ea-b3e5-36ff9923d32a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [3257f1c7-2c88-4858-ae12-6b713bf0e919] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 33468. Oct 26 11:24:29.734547 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-e908386a-a5be-43ea-b3e5-36ff9923d32a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 2.046088 Oct 26 11:24:29.744161 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 342/674] 10.222.0.42 () {62 vars in 1188 bytes} [Wed Oct 26 11:24:27 2022] POST /compute/v2.1/servers => generated 400 bytes in 2056 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 26 11:24:29.749797 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-ed671dd7-8328-4483-8aea-a181a50c2082 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:29.750465 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-ed671dd7-8328-4483-8aea-a181a50c2082 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:29.807686 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-ed671dd7-8328-4483-8aea-a181a50c2082 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:29.816631 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-ed671dd7-8328-4483-8aea-a181a50c2082 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:29.818526 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-ed671dd7-8328-4483-8aea-a181a50c2082 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:29.819859 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-ed671dd7-8328-4483-8aea-a181a50c2082 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1282 microversion: 2.20 time: 0.074514 Oct 26 11:24:29.820989 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 333/675] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:24:29 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1282 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:24:30.351369 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-7d8b6357-ff49-4e20-94a2-86e87dff64c0 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:30.352086 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-7d8b6357-ff49-4e20-94a2-86e87dff64c0 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:30.359031 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7d8b6357-ff49-4e20-94a2-86e87dff64c0 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:30.359592 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7d8b6357-ff49-4e20-94a2-86e87dff64c0 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:30.360339 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7d8b6357-ff49-4e20-94a2-86e87dff64c0 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:30.360960 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7d8b6357-ff49-4e20-94a2-86e87dff64c0 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:30.361410 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7d8b6357-ff49-4e20-94a2-86e87dff64c0 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:30.361831 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7d8b6357-ff49-4e20-94a2-86e87dff64c0 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:30.501619 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-7d8b6357-ff49-4e20-94a2-86e87dff64c0 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:30.510282 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-7d8b6357-ff49-4e20-94a2-86e87dff64c0 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1575 microversion: 2.1 time: 0.163448 Oct 26 11:24:30.511141 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 343/676] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:30 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:30.544089 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-7558f4f1-995d-454d-a19f-17e73653f15a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:30.544705 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-7558f4f1-995d-454d-a19f-17e73653f15a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:30.551722 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7558f4f1-995d-454d-a19f-17e73653f15a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:30.552819 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7558f4f1-995d-454d-a19f-17e73653f15a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:30.552819 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7558f4f1-995d-454d-a19f-17e73653f15a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:30.553321 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7558f4f1-995d-454d-a19f-17e73653f15a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:30.553779 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7558f4f1-995d-454d-a19f-17e73653f15a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:30.554211 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7558f4f1-995d-454d-a19f-17e73653f15a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:30.585844 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7558f4f1-995d-454d-a19f-17e73653f15a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:30.586331 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7558f4f1-995d-454d-a19f-17e73653f15a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:30.586771 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7558f4f1-995d-454d-a19f-17e73653f15a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:30.587245 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.objects.instance [None req-7558f4f1-995d-454d-a19f-17e73653f15a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lazy-loading 'fault' on Instance uuid 1f64d1d1-56f2-4ec0-b93a-faceb3411d40 {{(pid=119305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:24:30.628627 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-7558f4f1-995d-454d-a19f-17e73653f15a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:30.636999 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-7558f4f1-995d-454d-a19f-17e73653f15a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 200 len: 1231 microversion: 2.1 time: 0.096676 Oct 26 11:24:30.637578 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 334/677] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:30 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 1231 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:30.847828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-ab34cf2d-fac7-4061-813e-a784d4b82f61 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:30.848492 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-ab34cf2d-fac7-4061-813e-a784d4b82f61 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:30.854417 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ab34cf2d-fac7-4061-813e-a784d4b82f61 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:30.854935 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ab34cf2d-fac7-4061-813e-a784d4b82f61 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:30.855364 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ab34cf2d-fac7-4061-813e-a784d4b82f61 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:30.856154 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ab34cf2d-fac7-4061-813e-a784d4b82f61 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:30.856683 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ab34cf2d-fac7-4061-813e-a784d4b82f61 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:30.857107 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ab34cf2d-fac7-4061-813e-a784d4b82f61 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:30.920146 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ab34cf2d-fac7-4061-813e-a784d4b82f61 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:30.928866 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ab34cf2d-fac7-4061-813e-a784d4b82f61 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:30.932135 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ab34cf2d-fac7-4061-813e-a784d4b82f61 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:30.932135 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-ab34cf2d-fac7-4061-813e-a784d4b82f61 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1278 microversion: 2.20 time: 0.087626 Oct 26 11:24:30.932135 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 344/678] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:24:30 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1278 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:24:31.535153 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-f0431b19-5bf7-40bc-8f33-fb69ad62c31e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:31.535758 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-f0431b19-5bf7-40bc-8f33-fb69ad62c31e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:31.541666 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f0431b19-5bf7-40bc-8f33-fb69ad62c31e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:31.542139 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f0431b19-5bf7-40bc-8f33-fb69ad62c31e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:31.542566 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f0431b19-5bf7-40bc-8f33-fb69ad62c31e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:31.543275 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f0431b19-5bf7-40bc-8f33-fb69ad62c31e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:31.543723 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f0431b19-5bf7-40bc-8f33-fb69ad62c31e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:31.544144 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f0431b19-5bf7-40bc-8f33-fb69ad62c31e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:31.660755 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-a169b7f3-50b9-4471-83fb-2a5eb49bf15c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:31.661367 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-a169b7f3-50b9-4471-83fb-2a5eb49bf15c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:31.667615 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a169b7f3-50b9-4471-83fb-2a5eb49bf15c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:31.668100 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a169b7f3-50b9-4471-83fb-2a5eb49bf15c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:31.668536 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a169b7f3-50b9-4471-83fb-2a5eb49bf15c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:31.669224 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a169b7f3-50b9-4471-83fb-2a5eb49bf15c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:31.669678 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a169b7f3-50b9-4471-83fb-2a5eb49bf15c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:31.670125 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a169b7f3-50b9-4471-83fb-2a5eb49bf15c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:31.673682 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-f0431b19-5bf7-40bc-8f33-fb69ad62c31e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:31.682216 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-f0431b19-5bf7-40bc-8f33-fb69ad62c31e tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1575 microversion: 2.1 time: 0.150972 Oct 26 11:24:31.682780 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 335/679] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:31 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:31.684234 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.wsgi [None req-a169b7f3-50b9-4471-83fb-2a5eb49bf15c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] HTTP exception thrown: Instance 1f64d1d1-56f2-4ec0-b93a-faceb3411d40 could not be found. Oct 26 11:24:31.685909 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-a169b7f3-50b9-4471-83fb-2a5eb49bf15c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Request method failure captured: Oct 26 11:24:31.685909 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: request: GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 HTTP/1.1 Oct 26 11:24:31.685909 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept: application/json Oct 26 11:24:31.685909 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept-Encoding: identity Oct 26 11:24:31.685909 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Connection: close Oct 26 11:24:31.685909 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Length: 0 Oct 26 11:24:31.685909 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Type: application/json Oct 26 11:24:31.685909 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Host: 10.222.0.42 Oct 26 11:24:31.685909 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Openstack-System-Scope: None Oct 26 11:24:31.685909 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: User-Agent: python-urllib3/1.26.12 Oct 26 11:24:31.685909 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Auth-Token: gAAAAABjWRfbNpLZi4ehhxinHzLyHLguE5bpFXyCWdRz5wd7E74tg5HJJVRv8clONT6afl62Z2NRVo1fiUn-KTV4H_DhWPuGUFCfoQrS_hwunB25OMgryWhVgNo60E55f4dNNrihSGeHFIG2avl9kOUBSXoh15kKR-UWP7pL6h0FZziiSUbeMH8 Oct 26 11:24:31.685909 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Id: None Oct 26 11:24:31.685909 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Name: None Oct 26 11:24:31.685909 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Identity-Status: Confirmed Oct 26 11:24:31.685909 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Is-Admin-Project: True Oct 26 11:24:31.685909 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Id: default Oct 26 11:24:31.685909 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Name: Default Oct 26 11:24:31.685909 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Id: e378bfab9d91492e81320139fed867c6 Oct 26 11:24:31.685909 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Name: tempest-TestVolumeBootPattern-2087611894 Oct 26 11:24:31.685909 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Role: member,reader Oct 26 11:24:31.685909 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Roles: member,reader Oct 26 11:24:31.687486 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e378bfab9d91492e81320139fed867c6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e378bfab9d91492e81320139fed867c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e378bfab9d91492e81320139fed867c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e378bfab9d91492e81320139fed867c6"}]}] Oct 26 11:24:31.687486 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant: tempest-TestVolumeBootPattern-2087611894 Oct 26 11:24:31.687486 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Id: e378bfab9d91492e81320139fed867c6 Oct 26 11:24:31.687486 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Name: tempest-TestVolumeBootPattern-2087611894 Oct 26 11:24:31.687486 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User: tempest-TestVolumeBootPattern-2087611894-project Oct 26 11:24:31.687486 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Id: default Oct 26 11:24:31.687486 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Name: Default Oct 26 11:24:31.687486 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Id: 1f737b4d0531425cbc803fcd15a3ea1f Oct 26 11:24:31.687486 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Name: tempest-TestVolumeBootPattern-2087611894-project Oct 26 11:24:31.687486 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: method: > Oct 26 11:24:31.687486 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: exception: Instance 1f64d1d1-56f2-4ec0-b93a-faceb3411d40 could not be found. Oct 26 11:24:31.687486 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: action_args: {'id': '1f64d1d1-56f2-4ec0-b93a-faceb3411d40'} Oct 26 11:24:31.688384 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:24:31.688384 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:24:31.688384 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:24:31.688384 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:24:31.688384 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:24:31.688384 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:24:31.688384 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:24:31.688384 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:24:31.688384 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:24:31.688384 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:24:31.688384 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f64d1d1-56f2-4ec0-b93a-faceb3411d40 could not be found. Oct 26 11:24:31.688384 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:24:31.688384 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:24:31.688384 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:24:31.688384 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:24:31.688384 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:24:31.688384 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:24:31.688384 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:24:31.688384 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:24:31.688384 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:24:31.689745 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:24:31.689745 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 11:24:31.689745 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 11:24:31.689745 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:24:31.689745 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:24:31.689745 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:24:31.689745 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:24:31.689745 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f64d1d1-56f2-4ec0-b93a-faceb3411d40 could not be found. Oct 26 11:24:31.689745 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:24:31.689745 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:24:31.689745 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:24:31.689745 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:24:31.689745 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:24:31.689745 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:24:31.689745 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:24:31.689745 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:24:31.689745 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f64d1d1-56f2-4ec0-b93a-faceb3411d40 could not be found. Oct 26 11:24:31.689745 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:24:31.691568 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-a169b7f3-50b9-4471-83fb-2a5eb49bf15c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Returning 404 to user: Instance 1f64d1d1-56f2-4ec0-b93a-faceb3411d40 could not be found. {{(pid=119306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:24:31.691568 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-a169b7f3-50b9-4471-83fb-2a5eb49bf15c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 404 len: 111 microversion: 2.1 time: 0.030515 Oct 26 11:24:31.693537 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 345/680] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:31 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 11:24:31.839562 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-eb71061e-79cc-43bf-b3c1-ab0c9d568222 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-606671336", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1078387089", "security_groups": [{"name": "tempest-secgroup-smoke-1592834590"}], "block_device_mapping_v2": [{"uuid": "6e084556-cf83-4e79-b299-7eaa1860adc3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5b1f4268-e846-46c0-b38f-b877c6621858"}]}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:24:31.951588 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.network.neutron [None req-eb71061e-79cc-43bf-b3c1-ab0c9d568222 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] validate_networks() for [('5b1f4268-e846-46c0-b38f-b877c6621858', None, None, None, None, None)] {{(pid=119305) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 11:24:31.959162 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-39d06f76-82ae-4480-913e-7a8d4ace6b77 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:31.959782 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-39d06f76-82ae-4480-913e-7a8d4ace6b77 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:31.965712 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-39d06f76-82ae-4480-913e-7a8d4ace6b77 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:31.966193 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-39d06f76-82ae-4480-913e-7a8d4ace6b77 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:31.966625 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-39d06f76-82ae-4480-913e-7a8d4ace6b77 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:31.967348 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-39d06f76-82ae-4480-913e-7a8d4ace6b77 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:31.967801 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-39d06f76-82ae-4480-913e-7a8d4ace6b77 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:31.968223 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-39d06f76-82ae-4480-913e-7a8d4ace6b77 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:32.031242 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-39d06f76-82ae-4480-913e-7a8d4ace6b77 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:32.039818 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-39d06f76-82ae-4480-913e-7a8d4ace6b77 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:32.041297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-39d06f76-82ae-4480-913e-7a8d4ace6b77 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:32.042400 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-39d06f76-82ae-4480-913e-7a8d4ace6b77 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1334 microversion: 2.20 time: 0.087088 Oct 26 11:24:32.042987 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 346/681] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:24:31 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1334 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 11:24:32.323081 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-eb71061e-79cc-43bf-b3c1-ab0c9d568222 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Flavor limits 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 11:24:32.323517 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-eb71061e-79cc-43bf-b3c1-ab0c9d568222 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Image limits 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 11:24:32.324000 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-eb71061e-79cc-43bf-b3c1-ab0c9d568222 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Flavor pref 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 11:24:32.324413 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-eb71061e-79cc-43bf-b3c1-ab0c9d568222 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Image pref 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 11:24:32.324827 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-eb71061e-79cc-43bf-b3c1-ab0c9d568222 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 11:24:32.334020 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eb71061e-79cc-43bf-b3c1-ab0c9d568222 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:32.334505 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eb71061e-79cc-43bf-b3c1-ab0c9d568222 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:32.334972 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eb71061e-79cc-43bf-b3c1-ab0c9d568222 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:32.335704 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eb71061e-79cc-43bf-b3c1-ab0c9d568222 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:32.336162 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eb71061e-79cc-43bf-b3c1-ab0c9d568222 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:32.336584 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eb71061e-79cc-43bf-b3c1-ab0c9d568222 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:32.353710 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.quota [None req-eb71061e-79cc-43bf-b3c1-ab0c9d568222 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Getting quotas for project e378bfab9d91492e81320139fed867c6. Resources: {'cores', 'instances', 'ram'} {{(pid=119305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:24:32.357721 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.quota [None req-eb71061e-79cc-43bf-b3c1-ab0c9d568222 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Getting quotas for user 1f737b4d0531425cbc803fcd15a3ea1f and project e378bfab9d91492e81320139fed867c6. Resources: {'cores', 'instances', 'ram'} {{(pid=119305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:24:32.414944 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-eb71061e-79cc-43bf-b3c1-ab0c9d568222 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Going to run 1 instances... {{(pid=119305) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 11:24:32.417127 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-eb71061e-79cc-43bf-b3c1-ab0c9d568222 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 357ae7de-daf6-4dac-9370-1351f0fab0c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6e084556-cf83-4e79-b299-7eaa1860adc3',volume_size=None,volume_type=None)] {{(pid=119305) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 11:24:32.706073 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-c97832de-9f40-49e9-bb3a-2ad5b3d84f87 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:32.706708 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-c97832de-9f40-49e9-bb3a-2ad5b3d84f87 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:32.712989 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c97832de-9f40-49e9-bb3a-2ad5b3d84f87 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:32.713470 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c97832de-9f40-49e9-bb3a-2ad5b3d84f87 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:32.713958 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c97832de-9f40-49e9-bb3a-2ad5b3d84f87 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:32.714642 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c97832de-9f40-49e9-bb3a-2ad5b3d84f87 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:32.715186 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c97832de-9f40-49e9-bb3a-2ad5b3d84f87 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:32.715608 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c97832de-9f40-49e9-bb3a-2ad5b3d84f87 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:32.737643 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-eb71061e-79cc-43bf-b3c1-ab0c9d568222 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.901334 Oct 26 11:24:32.744590 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 336/682] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Oct 26 11:24:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 11:24:32.750180 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-5a9c5cc6-8223-447a-b869-c660af18c6bd tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:32.750796 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-5a9c5cc6-8223-447a-b869-c660af18c6bd tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 357ae7de-daf6-4dac-9370-1351f0fab0c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:32.807771 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-5a9c5cc6-8223-447a-b869-c660af18c6bd tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:32.814812 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-5a9c5cc6-8223-447a-b869-c660af18c6bd tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6" status: 200 len: 1094 microversion: 2.1 time: 0.068859 Oct 26 11:24:32.815430 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 337/683] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:32 2022] GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:32.927979 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-c97832de-9f40-49e9-bb3a-2ad5b3d84f87 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:32.935794 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-c97832de-9f40-49e9-bb3a-2ad5b3d84f87 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1575 microversion: 2.1 time: 0.233622 Oct 26 11:24:32.936368 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 347/684] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:32 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1575 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:24:33.067878 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-be8f61a1-39ff-4310-ab6b-469280e2c0d6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:33.068498 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-be8f61a1-39ff-4310-ab6b-469280e2c0d6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:33.075434 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-be8f61a1-39ff-4310-ab6b-469280e2c0d6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:33.076195 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-be8f61a1-39ff-4310-ab6b-469280e2c0d6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:33.076868 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-be8f61a1-39ff-4310-ab6b-469280e2c0d6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:33.077778 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-be8f61a1-39ff-4310-ab6b-469280e2c0d6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:33.078419 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-be8f61a1-39ff-4310-ab6b-469280e2c0d6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:33.079112 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-be8f61a1-39ff-4310-ab6b-469280e2c0d6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:33.146054 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-be8f61a1-39ff-4310-ab6b-469280e2c0d6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:33.154664 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-be8f61a1-39ff-4310-ab6b-469280e2c0d6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:33.156155 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-be8f61a1-39ff-4310-ab6b-469280e2c0d6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:33.157250 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-be8f61a1-39ff-4310-ab6b-469280e2c0d6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1352 microversion: 2.20 time: 0.093379 Oct 26 11:24:33.157860 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 338/685] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:24:33 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:24:33.837485 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-9bb6b0bd-d483-4b2b-88b6-9f9242f688f6 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:33.838092 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-9bb6b0bd-d483-4b2b-88b6-9f9242f688f6 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 357ae7de-daf6-4dac-9370-1351f0fab0c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:33.844622 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9bb6b0bd-d483-4b2b-88b6-9f9242f688f6 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:33.845101 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9bb6b0bd-d483-4b2b-88b6-9f9242f688f6 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:33.845527 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9bb6b0bd-d483-4b2b-88b6-9f9242f688f6 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:33.846207 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9bb6b0bd-d483-4b2b-88b6-9f9242f688f6 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:33.846660 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9bb6b0bd-d483-4b2b-88b6-9f9242f688f6 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:33.847105 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9bb6b0bd-d483-4b2b-88b6-9f9242f688f6 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:33.862295 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:24:33.921384 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-9bb6b0bd-d483-4b2b-88b6-9f9242f688f6 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:33.929960 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-9bb6b0bd-d483-4b2b-88b6-9f9242f688f6 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6" status: 200 len: 1144 microversion: 2.1 time: 0.096255 Oct 26 11:24:33.930735 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 348/686] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:33 2022] GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6 => generated 1144 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:33.964568 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-399bcb60-f4dc-4b69-b036-51d05633af0b tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:33.965178 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-399bcb60-f4dc-4b69-b036-51d05633af0b tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:33.971685 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-399bcb60-f4dc-4b69-b036-51d05633af0b tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:33.972107 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-399bcb60-f4dc-4b69-b036-51d05633af0b tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:33.972541 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-399bcb60-f4dc-4b69-b036-51d05633af0b tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:33.973228 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-399bcb60-f4dc-4b69-b036-51d05633af0b tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:33.973681 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-399bcb60-f4dc-4b69-b036-51d05633af0b tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:33.974099 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-399bcb60-f4dc-4b69-b036-51d05633af0b tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:34.109867 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-399bcb60-f4dc-4b69-b036-51d05633af0b tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:34.112208 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=100 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:24:34.118764 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-399bcb60-f4dc-4b69-b036-51d05633af0b tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1575 microversion: 2.1 time: 0.158002 Oct 26 11:24:34.119359 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 339/687] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:33 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:34.187460 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-050d342c-6321-40aa-a137-704bff069727 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:34.188224 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-050d342c-6321-40aa-a137-704bff069727 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:34.196534 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-050d342c-6321-40aa-a137-704bff069727 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:34.197042 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-050d342c-6321-40aa-a137-704bff069727 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:34.204667 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-050d342c-6321-40aa-a137-704bff069727 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:34.204667 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-050d342c-6321-40aa-a137-704bff069727 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:34.204667 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-050d342c-6321-40aa-a137-704bff069727 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:34.204667 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-050d342c-6321-40aa-a137-704bff069727 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:34.370197 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-050d342c-6321-40aa-a137-704bff069727 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:34.384216 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-050d342c-6321-40aa-a137-704bff069727 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:34.394053 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-050d342c-6321-40aa-a137-704bff069727 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:34.394053 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-050d342c-6321-40aa-a137-704bff069727 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1406 microversion: 2.20 time: 0.204859 Oct 26 11:24:34.394053 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 349/688] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:24:34 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:24:34.704288 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-02077f3b-6b5a-42bd-8fde-ead3cd2040f0 req-2204b8f2-d6e4-4c3e-a5d8-469111c6275c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "032aed92-2b14-4791-8612-a0261e6d77fd", "tag": "d48eea34-8900-4e01-bcd5-3b4a5f2f3dd1"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:24:34.714138 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-02077f3b-6b5a-42bd-8fde-ead3cd2040f0 req-2204b8f2-d6e4-4c3e-a5d8-469111c6275c service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:34.714623 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-02077f3b-6b5a-42bd-8fde-ead3cd2040f0 req-2204b8f2-d6e4-4c3e-a5d8-469111c6275c service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:34.715090 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-02077f3b-6b5a-42bd-8fde-ead3cd2040f0 req-2204b8f2-d6e4-4c3e-a5d8-469111c6275c service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:34.727511 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-02077f3b-6b5a-42bd-8fde-ead3cd2040f0 req-2204b8f2-d6e4-4c3e-a5d8-469111c6275c service nova] Creating event network-changed:d48eea34-8900-4e01-bcd5-3b4a5f2f3dd1 for instance 032aed92-2b14-4791-8612-a0261e6d77fd on hv-cinder-81558 Oct 26 11:24:34.732462 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-02077f3b-6b5a-42bd-8fde-ead3cd2040f0 req-2204b8f2-d6e4-4c3e-a5d8-469111c6275c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032894 Oct 26 11:24:34.733061 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 340/689] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:24:34.954212 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-85c3ef67-aef7-4eff-b4c7-42fe8a18d7c3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:34.954805 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-85c3ef67-aef7-4eff-b4c7-42fe8a18d7c3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 357ae7de-daf6-4dac-9370-1351f0fab0c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:34.962514 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-85c3ef67-aef7-4eff-b4c7-42fe8a18d7c3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:34.963383 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-85c3ef67-aef7-4eff-b4c7-42fe8a18d7c3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:34.964036 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-85c3ef67-aef7-4eff-b4c7-42fe8a18d7c3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:34.964727 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-85c3ef67-aef7-4eff-b4c7-42fe8a18d7c3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:34.965175 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-85c3ef67-aef7-4eff-b4c7-42fe8a18d7c3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:34.965592 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-85c3ef67-aef7-4eff-b4c7-42fe8a18d7c3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:35.041604 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-85c3ef67-aef7-4eff-b4c7-42fe8a18d7c3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:35.049616 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-85c3ef67-aef7-4eff-b4c7-42fe8a18d7c3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6" status: 200 len: 1192 microversion: 2.1 time: 0.099273 Oct 26 11:24:35.050190 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 350/690] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:34 2022] GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6 => generated 1192 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:24:35.152835 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-6884c424-9dcb-44df-8b4a-d280fe15367d tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:35.154570 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-6884c424-9dcb-44df-8b4a-d280fe15367d tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:35.162185 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6884c424-9dcb-44df-8b4a-d280fe15367d tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:35.162943 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6884c424-9dcb-44df-8b4a-d280fe15367d tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:35.163546 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6884c424-9dcb-44df-8b4a-d280fe15367d tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:35.164460 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6884c424-9dcb-44df-8b4a-d280fe15367d tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:35.165192 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6884c424-9dcb-44df-8b4a-d280fe15367d tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:35.165782 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6884c424-9dcb-44df-8b4a-d280fe15367d tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:35.372875 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-6884c424-9dcb-44df-8b4a-d280fe15367d tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:35.386878 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-6884c424-9dcb-44df-8b4a-d280fe15367d tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1575 microversion: 2.1 time: 0.243567 Oct 26 11:24:35.388024 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 341/691] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:35 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1575 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:35.413123 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-bfbc3e12-05a5-4af9-8839-aa9981638f8a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:35.414011 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-bfbc3e12-05a5-4af9-8839-aa9981638f8a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:35.415892 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:24:35.421334 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bfbc3e12-05a5-4af9-8839-aa9981638f8a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:35.422076 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bfbc3e12-05a5-4af9-8839-aa9981638f8a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:35.422906 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bfbc3e12-05a5-4af9-8839-aa9981638f8a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:35.424321 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bfbc3e12-05a5-4af9-8839-aa9981638f8a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:35.425056 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bfbc3e12-05a5-4af9-8839-aa9981638f8a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:35.425705 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bfbc3e12-05a5-4af9-8839-aa9981638f8a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:35.653240 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-bfbc3e12-05a5-4af9-8839-aa9981638f8a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:35.663876 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-bfbc3e12-05a5-4af9-8839-aa9981638f8a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:35.666098 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-bfbc3e12-05a5-4af9-8839-aa9981638f8a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:35.667827 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-bfbc3e12-05a5-4af9-8839-aa9981638f8a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1406 microversion: 2.20 time: 0.258615 Oct 26 11:24:35.679566 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 351/692] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:24:35 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1406 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:24:36.073384 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-934e3929-081d-4b17-8982-5719da61e66e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:36.073993 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-934e3929-081d-4b17-8982-5719da61e66e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 357ae7de-daf6-4dac-9370-1351f0fab0c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:36.079869 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-934e3929-081d-4b17-8982-5719da61e66e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:36.080783 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-934e3929-081d-4b17-8982-5719da61e66e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:36.081224 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-934e3929-081d-4b17-8982-5719da61e66e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:36.082122 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-934e3929-081d-4b17-8982-5719da61e66e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:36.082366 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-934e3929-081d-4b17-8982-5719da61e66e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:36.082789 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-934e3929-081d-4b17-8982-5719da61e66e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:36.246780 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-934e3929-081d-4b17-8982-5719da61e66e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:36.255157 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-934e3929-081d-4b17-8982-5719da61e66e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6" status: 200 len: 1278 microversion: 2.1 time: 0.185602 Oct 26 11:24:36.255734 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 342/693] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:36 2022] GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6 => generated 1278 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:36.411117 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-02a90ba9-70db-4be9-8e48-fb54db08b889 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:36.411727 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-02a90ba9-70db-4be9-8e48-fb54db08b889 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:36.417600 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-02a90ba9-70db-4be9-8e48-fb54db08b889 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:36.418082 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-02a90ba9-70db-4be9-8e48-fb54db08b889 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:36.418515 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-02a90ba9-70db-4be9-8e48-fb54db08b889 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:36.419247 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-02a90ba9-70db-4be9-8e48-fb54db08b889 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:36.419703 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-02a90ba9-70db-4be9-8e48-fb54db08b889 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:36.420127 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-02a90ba9-70db-4be9-8e48-fb54db08b889 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:36.546550 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-02a90ba9-70db-4be9-8e48-fb54db08b889 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:36.554889 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-02a90ba9-70db-4be9-8e48-fb54db08b889 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1575 microversion: 2.1 time: 0.148160 Oct 26 11:24:36.556460 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 352/694] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:36 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:24:36.694880 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-68346b5f-6884-4884-ad29-58ac333e5cc4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:36.695652 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-68346b5f-6884-4884-ad29-58ac333e5cc4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:36.715024 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:24:36.715024 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-68346b5f-6884-4884-ad29-58ac333e5cc4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:36.715024 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-68346b5f-6884-4884-ad29-58ac333e5cc4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:36.715024 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-68346b5f-6884-4884-ad29-58ac333e5cc4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:36.715651 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-68346b5f-6884-4884-ad29-58ac333e5cc4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:36.715651 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-68346b5f-6884-4884-ad29-58ac333e5cc4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:36.715651 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-68346b5f-6884-4884-ad29-58ac333e5cc4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:36.715894 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-d0f94ef5-65c9-43f1-855f-ed600815c370 req-040ba433-6a0a-4501-9beb-d254b7b117cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4b20a22-cb3b-4fb4-8b69-3b626cd6d991", "name": "network-vif-plugged", "status": "completed", "tag": "de570ff5-446d-40b7-add4-d927b658a166"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:24:36.717285 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-d0f94ef5-65c9-43f1-855f-ed600815c370 req-040ba433-6a0a-4501-9beb-d254b7b117cd service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:36.717867 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-d0f94ef5-65c9-43f1-855f-ed600815c370 req-040ba433-6a0a-4501-9beb-d254b7b117cd service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:36.718301 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-d0f94ef5-65c9-43f1-855f-ed600815c370 req-040ba433-6a0a-4501-9beb-d254b7b117cd service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:36.730644 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-d0f94ef5-65c9-43f1-855f-ed600815c370 req-040ba433-6a0a-4501-9beb-d254b7b117cd service nova] Creating event network-vif-plugged:de570ff5-446d-40b7-add4-d927b658a166 for instance e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 on hv-cinder-81558 Oct 26 11:24:36.735983 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-d0f94ef5-65c9-43f1-855f-ed600815c370 req-040ba433-6a0a-4501-9beb-d254b7b117cd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034780 Oct 26 11:24:36.737113 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 353/695] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:24:36.849960 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-68346b5f-6884-4884-ad29-58ac333e5cc4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:36.858011 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-68346b5f-6884-4884-ad29-58ac333e5cc4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:36.859462 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-68346b5f-6884-4884-ad29-58ac333e5cc4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:36.860557 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-68346b5f-6884-4884-ad29-58ac333e5cc4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1406 microversion: 2.20 time: 0.169779 Oct 26 11:24:36.861139 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 343/696] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:24:36 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:24:37.278253 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-53ca4aa8-b4af-4c63-bd21-8e78c0351939 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:37.278983 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-53ca4aa8-b4af-4c63-bd21-8e78c0351939 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 357ae7de-daf6-4dac-9370-1351f0fab0c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:37.285507 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-53ca4aa8-b4af-4c63-bd21-8e78c0351939 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:37.285979 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-53ca4aa8-b4af-4c63-bd21-8e78c0351939 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:37.286404 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-53ca4aa8-b4af-4c63-bd21-8e78c0351939 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:37.287108 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-53ca4aa8-b4af-4c63-bd21-8e78c0351939 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:37.287557 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-53ca4aa8-b4af-4c63-bd21-8e78c0351939 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:37.287973 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-53ca4aa8-b4af-4c63-bd21-8e78c0351939 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:37.419503 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-53ca4aa8-b4af-4c63-bd21-8e78c0351939 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:37.427141 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-53ca4aa8-b4af-4c63-bd21-8e78c0351939 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6" status: 200 len: 1278 microversion: 2.1 time: 0.153389 Oct 26 11:24:37.427704 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 354/697] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:37 2022] GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:37.579097 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-cfd87e85-64ca-42b6-9afc-27cce8bd2dbd tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:37.579642 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-cfd87e85-64ca-42b6-9afc-27cce8bd2dbd tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:37.586962 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cfd87e85-64ca-42b6-9afc-27cce8bd2dbd tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:37.587442 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cfd87e85-64ca-42b6-9afc-27cce8bd2dbd tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:37.587870 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cfd87e85-64ca-42b6-9afc-27cce8bd2dbd tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:37.588551 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cfd87e85-64ca-42b6-9afc-27cce8bd2dbd tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:37.588997 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cfd87e85-64ca-42b6-9afc-27cce8bd2dbd tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:37.589415 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cfd87e85-64ca-42b6-9afc-27cce8bd2dbd tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:37.716064 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-cfd87e85-64ca-42b6-9afc-27cce8bd2dbd tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:37.724454 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-cfd87e85-64ca-42b6-9afc-27cce8bd2dbd tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1575 microversion: 2.1 time: 0.149294 Oct 26 11:24:37.725081 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 344/698] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:37 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:37.884859 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-9ce68e61-80e7-48c0-ba8d-46c01a035926 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:37.885588 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-9ce68e61-80e7-48c0-ba8d-46c01a035926 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:37.892160 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9ce68e61-80e7-48c0-ba8d-46c01a035926 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:37.892647 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9ce68e61-80e7-48c0-ba8d-46c01a035926 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:37.893082 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9ce68e61-80e7-48c0-ba8d-46c01a035926 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:37.894374 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9ce68e61-80e7-48c0-ba8d-46c01a035926 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:37.894847 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9ce68e61-80e7-48c0-ba8d-46c01a035926 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:37.895274 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9ce68e61-80e7-48c0-ba8d-46c01a035926 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:38.019482 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-9ce68e61-80e7-48c0-ba8d-46c01a035926 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:38.027756 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-9ce68e61-80e7-48c0-ba8d-46c01a035926 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:38.029227 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-9ce68e61-80e7-48c0-ba8d-46c01a035926 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:38.030338 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-9ce68e61-80e7-48c0-ba8d-46c01a035926 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1406 microversion: 2.20 time: 0.149544 Oct 26 11:24:38.030923 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 355/699] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:24:37 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:24:38.449537 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-e3523602-9cc3-4d8f-a4ec-4a22f145ac56 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:38.450151 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-e3523602-9cc3-4d8f-a4ec-4a22f145ac56 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 357ae7de-daf6-4dac-9370-1351f0fab0c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:38.458126 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e3523602-9cc3-4d8f-a4ec-4a22f145ac56 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:38.458622 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e3523602-9cc3-4d8f-a4ec-4a22f145ac56 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:38.459089 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e3523602-9cc3-4d8f-a4ec-4a22f145ac56 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:38.459815 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e3523602-9cc3-4d8f-a4ec-4a22f145ac56 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:38.460270 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e3523602-9cc3-4d8f-a4ec-4a22f145ac56 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:38.460693 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e3523602-9cc3-4d8f-a4ec-4a22f145ac56 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:38.670687 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-e3523602-9cc3-4d8f-a4ec-4a22f145ac56 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:38.679272 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-e3523602-9cc3-4d8f-a4ec-4a22f145ac56 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6" status: 200 len: 1278 microversion: 2.1 time: 0.233497 Oct 26 11:24:38.695991 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 345/700] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:38 2022] GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6 => generated 1278 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:38.750110 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-06fe9555-7f0e-47a1-80a2-5cc0532587b7 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:38.752021 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-06fe9555-7f0e-47a1-80a2-5cc0532587b7 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:38.753437 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell0:SELECT=2 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:24:38.754113 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell0:SELECT=10 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:24:38.758703 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-06fe9555-7f0e-47a1-80a2-5cc0532587b7 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:38.759258 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-06fe9555-7f0e-47a1-80a2-5cc0532587b7 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:38.759691 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-06fe9555-7f0e-47a1-80a2-5cc0532587b7 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:38.760373 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-06fe9555-7f0e-47a1-80a2-5cc0532587b7 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:38.760818 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-06fe9555-7f0e-47a1-80a2-5cc0532587b7 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:38.761229 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-06fe9555-7f0e-47a1-80a2-5cc0532587b7 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:38.901102 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-06fe9555-7f0e-47a1-80a2-5cc0532587b7 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:38.909537 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-06fe9555-7f0e-47a1-80a2-5cc0532587b7 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1575 microversion: 2.1 time: 0.162549 Oct 26 11:24:38.910109 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 356/701] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:38 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:39.055130 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-0c505155-ec56-4986-afb0-ddebe70228e8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:39.055740 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-0c505155-ec56-4986-afb0-ddebe70228e8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:39.061673 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0c505155-ec56-4986-afb0-ddebe70228e8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:39.062155 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0c505155-ec56-4986-afb0-ddebe70228e8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:39.062584 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0c505155-ec56-4986-afb0-ddebe70228e8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:39.063287 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0c505155-ec56-4986-afb0-ddebe70228e8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:39.063733 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0c505155-ec56-4986-afb0-ddebe70228e8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:39.064204 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0c505155-ec56-4986-afb0-ddebe70228e8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:39.160900 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-b90aba6f-7ffe-4e37-973f-d2aebb98a666 req-8c0af01b-ac0f-46aa-9b8e-07d0b79aa576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "357ae7de-daf6-4dac-9370-1351f0fab0c6", "tag": "4098a34c-ed38-40c7-a957-cd9dc982a278"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:24:39.170248 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-b90aba6f-7ffe-4e37-973f-d2aebb98a666 req-8c0af01b-ac0f-46aa-9b8e-07d0b79aa576 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:39.170717 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-b90aba6f-7ffe-4e37-973f-d2aebb98a666 req-8c0af01b-ac0f-46aa-9b8e-07d0b79aa576 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:39.171160 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-b90aba6f-7ffe-4e37-973f-d2aebb98a666 req-8c0af01b-ac0f-46aa-9b8e-07d0b79aa576 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:39.181937 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-b90aba6f-7ffe-4e37-973f-d2aebb98a666 req-8c0af01b-ac0f-46aa-9b8e-07d0b79aa576 service nova] Creating event network-changed:4098a34c-ed38-40c7-a957-cd9dc982a278 for instance 357ae7de-daf6-4dac-9370-1351f0fab0c6 on hv-cinder-81558 Oct 26 11:24:39.186734 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-b90aba6f-7ffe-4e37-973f-d2aebb98a666 req-8c0af01b-ac0f-46aa-9b8e-07d0b79aa576 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030136 Oct 26 11:24:39.187365 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 357/702] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:24:39.244440 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-0c505155-ec56-4986-afb0-ddebe70228e8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:39.253343 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-0c505155-ec56-4986-afb0-ddebe70228e8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:39.255033 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-0c505155-ec56-4986-afb0-ddebe70228e8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:39.256167 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-0c505155-ec56-4986-afb0-ddebe70228e8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1406 microversion: 2.20 time: 0.204915 Oct 26 11:24:39.256715 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 346/703] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:24:39 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:24:39.703186 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-4b50238f-c1fe-4816-bbbe-d26cec0552e8 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:39.703847 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-4b50238f-c1fe-4816-bbbe-d26cec0552e8 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 357ae7de-daf6-4dac-9370-1351f0fab0c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:39.710545 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4b50238f-c1fe-4816-bbbe-d26cec0552e8 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:39.711056 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4b50238f-c1fe-4816-bbbe-d26cec0552e8 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:39.711486 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4b50238f-c1fe-4816-bbbe-d26cec0552e8 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:39.712165 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4b50238f-c1fe-4816-bbbe-d26cec0552e8 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:39.712610 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4b50238f-c1fe-4816-bbbe-d26cec0552e8 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:39.713027 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4b50238f-c1fe-4816-bbbe-d26cec0552e8 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:39.844964 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-4b50238f-c1fe-4816-bbbe-d26cec0552e8 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:39.853318 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-4b50238f-c1fe-4816-bbbe-d26cec0552e8 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6" status: 200 len: 1266 microversion: 2.1 time: 0.154415 Oct 26 11:24:39.854019 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 358/704] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:39 2022] GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:39.932596 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-bcf81350-8a76-430a-a140-9dce492270b1 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:39.933307 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-bcf81350-8a76-430a-a140-9dce492270b1 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:39.939659 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bcf81350-8a76-430a-a140-9dce492270b1 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:39.940121 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bcf81350-8a76-430a-a140-9dce492270b1 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:39.940549 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bcf81350-8a76-430a-a140-9dce492270b1 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:39.941228 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bcf81350-8a76-430a-a140-9dce492270b1 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:39.941675 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bcf81350-8a76-430a-a140-9dce492270b1 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:39.942095 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bcf81350-8a76-430a-a140-9dce492270b1 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:40.131293 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-bcf81350-8a76-430a-a140-9dce492270b1 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:40.138863 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-bcf81350-8a76-430a-a140-9dce492270b1 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1575 microversion: 2.1 time: 0.210107 Oct 26 11:24:40.139424 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 347/705] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:39 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1575 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:40.281378 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-08d8d50c-87cf-4137-bac3-14292e7af5e0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:40.281977 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-08d8d50c-87cf-4137-bac3-14292e7af5e0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:40.288328 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-08d8d50c-87cf-4137-bac3-14292e7af5e0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:40.288809 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-08d8d50c-87cf-4137-bac3-14292e7af5e0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:40.289237 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-08d8d50c-87cf-4137-bac3-14292e7af5e0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:40.289912 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-08d8d50c-87cf-4137-bac3-14292e7af5e0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:40.290356 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-08d8d50c-87cf-4137-bac3-14292e7af5e0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:40.290769 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-08d8d50c-87cf-4137-bac3-14292e7af5e0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:40.416959 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-08d8d50c-87cf-4137-bac3-14292e7af5e0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:40.425490 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-08d8d50c-87cf-4137-bac3-14292e7af5e0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:40.427007 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-08d8d50c-87cf-4137-bac3-14292e7af5e0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:40.428116 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-08d8d50c-87cf-4137-bac3-14292e7af5e0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1406 microversion: 2.20 time: 0.150661 Oct 26 11:24:40.428681 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 359/706] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:24:40 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:24:40.875785 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-2838938e-d859-4fcc-8078-67979f2bf90d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:40.876420 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-2838938e-d859-4fcc-8078-67979f2bf90d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 357ae7de-daf6-4dac-9370-1351f0fab0c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:40.882413 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2838938e-d859-4fcc-8078-67979f2bf90d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:40.882849 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2838938e-d859-4fcc-8078-67979f2bf90d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:40.883328 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2838938e-d859-4fcc-8078-67979f2bf90d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:40.884019 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2838938e-d859-4fcc-8078-67979f2bf90d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:40.884473 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2838938e-d859-4fcc-8078-67979f2bf90d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:40.884896 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2838938e-d859-4fcc-8078-67979f2bf90d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:41.085571 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-2838938e-d859-4fcc-8078-67979f2bf90d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:41.093221 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-2838938e-d859-4fcc-8078-67979f2bf90d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6" status: 200 len: 1266 microversion: 2.1 time: 0.221336 Oct 26 11:24:41.093801 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 348/707] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:40 2022] GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:41.162191 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-10eabb88-ff67-496d-93eb-1abbaa6f4aab tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:41.162952 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-10eabb88-ff67-496d-93eb-1abbaa6f4aab tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:41.168762 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-10eabb88-ff67-496d-93eb-1abbaa6f4aab tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:41.169267 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-10eabb88-ff67-496d-93eb-1abbaa6f4aab tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:41.169706 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-10eabb88-ff67-496d-93eb-1abbaa6f4aab tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:41.170398 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-10eabb88-ff67-496d-93eb-1abbaa6f4aab tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:41.170875 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-10eabb88-ff67-496d-93eb-1abbaa6f4aab tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:41.171300 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-10eabb88-ff67-496d-93eb-1abbaa6f4aab tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:41.299999 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-10eabb88-ff67-496d-93eb-1abbaa6f4aab tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:41.308029 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-10eabb88-ff67-496d-93eb-1abbaa6f4aab tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1562 microversion: 2.1 time: 0.149812 Oct 26 11:24:41.308610 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 360/708] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:41 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:41.453830 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-18a27e04-f95a-4be1-9bf9-947a10b10e76 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:41.454361 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-18a27e04-f95a-4be1-9bf9-947a10b10e76 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:41.460275 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-18a27e04-f95a-4be1-9bf9-947a10b10e76 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:41.460758 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-18a27e04-f95a-4be1-9bf9-947a10b10e76 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:41.461194 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-18a27e04-f95a-4be1-9bf9-947a10b10e76 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:41.461908 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-18a27e04-f95a-4be1-9bf9-947a10b10e76 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:41.462364 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-18a27e04-f95a-4be1-9bf9-947a10b10e76 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:41.462789 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-18a27e04-f95a-4be1-9bf9-947a10b10e76 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:41.587184 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-18a27e04-f95a-4be1-9bf9-947a10b10e76 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:41.595146 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-18a27e04-f95a-4be1-9bf9-947a10b10e76 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:41.597107 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-18a27e04-f95a-4be1-9bf9-947a10b10e76 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:41.598201 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-18a27e04-f95a-4be1-9bf9-947a10b10e76 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1406 microversion: 2.20 time: 0.148480 Oct 26 11:24:41.598763 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 349/709] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:24:41 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:24:42.115956 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-2d7168c2-1c40-4ff3-b14d-b589af317489 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:42.116562 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-2d7168c2-1c40-4ff3-b14d-b589af317489 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 357ae7de-daf6-4dac-9370-1351f0fab0c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:42.122457 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2d7168c2-1c40-4ff3-b14d-b589af317489 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:42.122971 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2d7168c2-1c40-4ff3-b14d-b589af317489 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:42.123401 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2d7168c2-1c40-4ff3-b14d-b589af317489 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:42.124077 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2d7168c2-1c40-4ff3-b14d-b589af317489 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:42.124527 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2d7168c2-1c40-4ff3-b14d-b589af317489 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:42.124941 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2d7168c2-1c40-4ff3-b14d-b589af317489 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:42.255421 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-2d7168c2-1c40-4ff3-b14d-b589af317489 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:42.263101 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-2d7168c2-1c40-4ff3-b14d-b589af317489 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6" status: 200 len: 1266 microversion: 2.1 time: 0.151024 Oct 26 11:24:42.263679 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 361/710] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:42 2022] GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:42.627723 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-6f5a7663-ce0d-43f7-8105-0329ca65f75b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:42.627723 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-6f5a7663-ce0d-43f7-8105-0329ca65f75b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:42.627723 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell0:SELECT=2 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:24:42.632199 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6f5a7663-ce0d-43f7-8105-0329ca65f75b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:42.632675 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6f5a7663-ce0d-43f7-8105-0329ca65f75b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:42.633107 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6f5a7663-ce0d-43f7-8105-0329ca65f75b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:42.633901 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6f5a7663-ce0d-43f7-8105-0329ca65f75b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:42.634349 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6f5a7663-ce0d-43f7-8105-0329ca65f75b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:42.634775 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6f5a7663-ce0d-43f7-8105-0329ca65f75b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:42.764701 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-6f5a7663-ce0d-43f7-8105-0329ca65f75b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:42.772917 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-6f5a7663-ce0d-43f7-8105-0329ca65f75b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:42.774590 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-6f5a7663-ce0d-43f7-8105-0329ca65f75b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:42.775718 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-6f5a7663-ce0d-43f7-8105-0329ca65f75b tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1406 microversion: 2.20 time: 0.155996 Oct 26 11:24:42.776278 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 350/711] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:24:42 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:24:42.791633 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-356467e6-2cd0-463c-834d-f3042cd77a3f req-d2538b9b-be7a-4a47-9489-f46a33f3c936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "032aed92-2b14-4791-8612-a0261e6d77fd", "name": "network-vif-plugged", "status": "completed", "tag": "d48eea34-8900-4e01-bcd5-3b4a5f2f3dd1"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:24:42.802269 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-356467e6-2cd0-463c-834d-f3042cd77a3f req-d2538b9b-be7a-4a47-9489-f46a33f3c936 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:42.802750 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-356467e6-2cd0-463c-834d-f3042cd77a3f req-d2538b9b-be7a-4a47-9489-f46a33f3c936 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:42.803211 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-356467e6-2cd0-463c-834d-f3042cd77a3f req-d2538b9b-be7a-4a47-9489-f46a33f3c936 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:42.814081 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-356467e6-2cd0-463c-834d-f3042cd77a3f req-d2538b9b-be7a-4a47-9489-f46a33f3c936 service nova] Creating event network-vif-plugged:d48eea34-8900-4e01-bcd5-3b4a5f2f3dd1 for instance 032aed92-2b14-4791-8612-a0261e6d77fd on hv-cinder-81558 Oct 26 11:24:42.819422 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-356467e6-2cd0-463c-834d-f3042cd77a3f req-d2538b9b-be7a-4a47-9489-f46a33f3c936 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031813 Oct 26 11:24:42.820045 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 362/712] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:24:42.928730 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-ee3047a8-a992-4581-b3e6-dd548f197858 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:42.929241 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-ee3047a8-a992-4581-b3e6-dd548f197858 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:42.931091 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell0:SELECT=10 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:24:42.940494 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ee3047a8-a992-4581-b3e6-dd548f197858 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:42.943841 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ee3047a8-a992-4581-b3e6-dd548f197858 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:42.943841 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ee3047a8-a992-4581-b3e6-dd548f197858 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:42.943841 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ee3047a8-a992-4581-b3e6-dd548f197858 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:42.943841 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ee3047a8-a992-4581-b3e6-dd548f197858 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:42.944225 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ee3047a8-a992-4581-b3e6-dd548f197858 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:43.071919 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.objects.instance [None req-ee3047a8-a992-4581-b3e6-dd548f197858 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lazy-loading 'services' on Instance uuid 975e97a1-fe2c-4f81-88b5-274a052109c6 {{(pid=119305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:24:43.287750 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-5aae7ca0-62f0-47bc-997f-d55dd20081b1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:43.288501 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-5aae7ca0-62f0-47bc-997f-d55dd20081b1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 357ae7de-daf6-4dac-9370-1351f0fab0c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:43.294636 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5aae7ca0-62f0-47bc-997f-d55dd20081b1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:43.295158 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5aae7ca0-62f0-47bc-997f-d55dd20081b1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:43.295588 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5aae7ca0-62f0-47bc-997f-d55dd20081b1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:43.296330 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5aae7ca0-62f0-47bc-997f-d55dd20081b1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:43.296780 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5aae7ca0-62f0-47bc-997f-d55dd20081b1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:43.297202 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5aae7ca0-62f0-47bc-997f-d55dd20081b1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:43.315445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-ee3047a8-a992-4581-b3e6-dd548f197858 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "DELETE /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6/os-volume_attachments/b3133d64-8a09-4094-8900-c06fbadf546f" status: 202 len: 0 microversion: 2.1 time: 0.390416 Oct 26 11:24:43.316062 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 351/713] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Oct 26 11:24:42 2022] DELETE /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6/os-volume_attachments/b3133d64-8a09-4094-8900-c06fbadf546f => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 11:24:43.324744 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-932260c9-fc7b-4410-8184-c6b2ff5af89c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:43.327044 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-932260c9-fc7b-4410-8184-c6b2ff5af89c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:43.333788 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-932260c9-fc7b-4410-8184-c6b2ff5af89c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:43.334266 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-932260c9-fc7b-4410-8184-c6b2ff5af89c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:43.334698 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-932260c9-fc7b-4410-8184-c6b2ff5af89c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:43.335414 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-932260c9-fc7b-4410-8184-c6b2ff5af89c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:43.335859 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-932260c9-fc7b-4410-8184-c6b2ff5af89c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:43.336330 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-932260c9-fc7b-4410-8184-c6b2ff5af89c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:43.366389 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-932260c9-fc7b-4410-8184-c6b2ff5af89c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045654 Oct 26 11:24:43.367007 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 352/714] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Oct 26 11:24:43 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:24:43.427171 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-5aae7ca0-62f0-47bc-997f-d55dd20081b1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:43.434790 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-5aae7ca0-62f0-47bc-997f-d55dd20081b1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6" status: 200 len: 1266 microversion: 2.1 time: 0.151711 Oct 26 11:24:43.435383 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 363/715] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:43 2022] GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:24:43.799568 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-b0aed4df-43ad-4972-a3e0-46c576042caf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:43.800173 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-b0aed4df-43ad-4972-a3e0-46c576042caf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:43.806451 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b0aed4df-43ad-4972-a3e0-46c576042caf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:43.806969 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b0aed4df-43ad-4972-a3e0-46c576042caf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:43.807387 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b0aed4df-43ad-4972-a3e0-46c576042caf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:43.808064 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b0aed4df-43ad-4972-a3e0-46c576042caf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:43.808540 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b0aed4df-43ad-4972-a3e0-46c576042caf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:43.808960 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b0aed4df-43ad-4972-a3e0-46c576042caf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:43.937798 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-b0aed4df-43ad-4972-a3e0-46c576042caf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:43.946302 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-b0aed4df-43ad-4972-a3e0-46c576042caf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:43.947755 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-b0aed4df-43ad-4972-a3e0-46c576042caf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:43.948842 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-b0aed4df-43ad-4972-a3e0-46c576042caf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1406 microversion: 2.20 time: 0.153235 Oct 26 11:24:43.949400 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 353/716] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:24:43 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:24:44.386023 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-74aaf873-6c1e-4f0f-adfb-e0f2448b6558 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:44.388195 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-74aaf873-6c1e-4f0f-adfb-e0f2448b6558 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:44.395089 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-74aaf873-6c1e-4f0f-adfb-e0f2448b6558 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:44.395562 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-74aaf873-6c1e-4f0f-adfb-e0f2448b6558 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:44.395993 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-74aaf873-6c1e-4f0f-adfb-e0f2448b6558 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:44.396676 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-74aaf873-6c1e-4f0f-adfb-e0f2448b6558 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:44.397126 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-74aaf873-6c1e-4f0f-adfb-e0f2448b6558 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:44.397548 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-74aaf873-6c1e-4f0f-adfb-e0f2448b6558 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:44.428371 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-74aaf873-6c1e-4f0f-adfb-e0f2448b6558 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046267 Oct 26 11:24:44.428923 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 364/717] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Oct 26 11:24:44 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:24:44.457993 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-73631835-383f-4208-8d2b-a54a06dfb35f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:44.458608 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-73631835-383f-4208-8d2b-a54a06dfb35f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 357ae7de-daf6-4dac-9370-1351f0fab0c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:44.464673 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-73631835-383f-4208-8d2b-a54a06dfb35f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:44.465188 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-73631835-383f-4208-8d2b-a54a06dfb35f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:44.465627 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-73631835-383f-4208-8d2b-a54a06dfb35f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:44.466325 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-73631835-383f-4208-8d2b-a54a06dfb35f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:44.466763 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-73631835-383f-4208-8d2b-a54a06dfb35f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:44.467216 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-73631835-383f-4208-8d2b-a54a06dfb35f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:44.595570 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-73631835-383f-4208-8d2b-a54a06dfb35f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:44.603446 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-73631835-383f-4208-8d2b-a54a06dfb35f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6" status: 200 len: 1266 microversion: 2.1 time: 0.149781 Oct 26 11:24:44.604026 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 354/718] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:44 2022] GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:44.973612 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-9888d3e0-a63e-4773-8a7c-84e5b64ccd31 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:44.974257 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-9888d3e0-a63e-4773-8a7c-84e5b64ccd31 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:44.980185 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9888d3e0-a63e-4773-8a7c-84e5b64ccd31 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:44.980669 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9888d3e0-a63e-4773-8a7c-84e5b64ccd31 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:44.981107 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9888d3e0-a63e-4773-8a7c-84e5b64ccd31 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:44.982884 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9888d3e0-a63e-4773-8a7c-84e5b64ccd31 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:44.982884 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9888d3e0-a63e-4773-8a7c-84e5b64ccd31 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:44.982884 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9888d3e0-a63e-4773-8a7c-84e5b64ccd31 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:45.113109 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-9888d3e0-a63e-4773-8a7c-84e5b64ccd31 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:45.121172 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-9888d3e0-a63e-4773-8a7c-84e5b64ccd31 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:45.122640 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-9888d3e0-a63e-4773-8a7c-84e5b64ccd31 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:45.123824 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-9888d3e0-a63e-4773-8a7c-84e5b64ccd31 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1406 microversion: 2.20 time: 0.154251 Oct 26 11:24:45.124389 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 365/719] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:24:44 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:24:45.440939 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-f636ad7e-f9d6-4d8b-8117-1231588989b2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:45.443346 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-f636ad7e-f9d6-4d8b-8117-1231588989b2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:45.449554 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f636ad7e-f9d6-4d8b-8117-1231588989b2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:45.450036 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f636ad7e-f9d6-4d8b-8117-1231588989b2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:45.450464 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f636ad7e-f9d6-4d8b-8117-1231588989b2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:45.451184 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f636ad7e-f9d6-4d8b-8117-1231588989b2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:45.451634 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f636ad7e-f9d6-4d8b-8117-1231588989b2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:45.452055 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f636ad7e-f9d6-4d8b-8117-1231588989b2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:45.481874 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-f636ad7e-f9d6-4d8b-8117-1231588989b2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044936 Oct 26 11:24:45.482443 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 355/720] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Oct 26 11:24:45 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:24:45.625490 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-22da0492-44bb-4964-b131-5416f3f55aac tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:45.626098 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-22da0492-44bb-4964-b131-5416f3f55aac tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 357ae7de-daf6-4dac-9370-1351f0fab0c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:45.632523 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-22da0492-44bb-4964-b131-5416f3f55aac tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:45.633008 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-22da0492-44bb-4964-b131-5416f3f55aac tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:45.633437 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-22da0492-44bb-4964-b131-5416f3f55aac tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:45.634122 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-22da0492-44bb-4964-b131-5416f3f55aac tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:45.634569 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-22da0492-44bb-4964-b131-5416f3f55aac tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:45.635022 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-22da0492-44bb-4964-b131-5416f3f55aac tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:45.765956 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-22da0492-44bb-4964-b131-5416f3f55aac tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:45.774665 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-22da0492-44bb-4964-b131-5416f3f55aac tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6" status: 200 len: 1266 microversion: 2.1 time: 0.152789 Oct 26 11:24:45.775293 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 366/721] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:45 2022] GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:46.150910 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a9651431-0d48-4667-9115-4c0641af3e9e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:46.151720 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-a9651431-0d48-4667-9115-4c0641af3e9e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:46.158401 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a9651431-0d48-4667-9115-4c0641af3e9e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:46.158936 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a9651431-0d48-4667-9115-4c0641af3e9e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:46.159398 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a9651431-0d48-4667-9115-4c0641af3e9e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:46.160186 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a9651431-0d48-4667-9115-4c0641af3e9e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:46.160645 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a9651431-0d48-4667-9115-4c0641af3e9e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:46.161052 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a9651431-0d48-4667-9115-4c0641af3e9e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:46.179189 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:24:46.291273 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-a9651431-0d48-4667-9115-4c0641af3e9e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:46.299176 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-a9651431-0d48-4667-9115-4c0641af3e9e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:46.300595 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-a9651431-0d48-4667-9115-4c0641af3e9e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:46.301930 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-a9651431-0d48-4667-9115-4c0641af3e9e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1599 microversion: 2.20 time: 0.155921 Oct 26 11:24:46.302484 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 356/722] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:24:46 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:24:46.326590 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-710df4c2-7df1-42d6-9fb0-e2235fc9a632 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:46.327126 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-710df4c2-7df1-42d6-9fb0-e2235fc9a632 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:46.333607 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-710df4c2-7df1-42d6-9fb0-e2235fc9a632 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:46.334089 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-710df4c2-7df1-42d6-9fb0-e2235fc9a632 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:46.334526 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-710df4c2-7df1-42d6-9fb0-e2235fc9a632 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:46.335241 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-710df4c2-7df1-42d6-9fb0-e2235fc9a632 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:46.335720 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-710df4c2-7df1-42d6-9fb0-e2235fc9a632 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:46.336144 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-710df4c2-7df1-42d6-9fb0-e2235fc9a632 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:46.339804 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=100 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:24:46.411048 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-710df4c2-7df1-42d6-9fb0-e2235fc9a632 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.088400 Oct 26 11:24:46.411667 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 367/723] 10.222.0.42 () {60 vars in 1316 bytes} [Wed Oct 26 11:24:46 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 11:24:46.495225 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-cc6967d6-dd2d-4489-971f-df140a0af6fa tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:46.497342 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-cc6967d6-dd2d-4489-971f-df140a0af6fa tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:46.504153 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cc6967d6-dd2d-4489-971f-df140a0af6fa tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:46.504638 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cc6967d6-dd2d-4489-971f-df140a0af6fa tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:46.505071 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cc6967d6-dd2d-4489-971f-df140a0af6fa tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:46.505759 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cc6967d6-dd2d-4489-971f-df140a0af6fa tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:46.506206 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cc6967d6-dd2d-4489-971f-df140a0af6fa tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:46.506657 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cc6967d6-dd2d-4489-971f-df140a0af6fa tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:46.535528 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-cc6967d6-dd2d-4489-971f-df140a0af6fa tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044364 Oct 26 11:24:46.536115 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 357/724] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Oct 26 11:24:46 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 11:24:46.615163 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-1f7bae5b-fb99-468b-8f40-2304c74c4e2c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:46.615761 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-1f7bae5b-fb99-468b-8f40-2304c74c4e2c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:46.621689 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1f7bae5b-fb99-468b-8f40-2304c74c4e2c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:46.622170 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1f7bae5b-fb99-468b-8f40-2304c74c4e2c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:46.622603 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1f7bae5b-fb99-468b-8f40-2304c74c4e2c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:46.623328 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1f7bae5b-fb99-468b-8f40-2304c74c4e2c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:46.623777 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1f7bae5b-fb99-468b-8f40-2304c74c4e2c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:46.624228 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1f7bae5b-fb99-468b-8f40-2304c74c4e2c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:46.649789 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-1f7bae5b-fb99-468b-8f40-2304c74c4e2c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Going to try to terminate instance {{(pid=119306) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 11:24:46.797181 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-26213a28-7744-4beb-afb8-0378bd23a8a1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:46.797972 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-26213a28-7744-4beb-afb8-0378bd23a8a1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 357ae7de-daf6-4dac-9370-1351f0fab0c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:46.803798 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-26213a28-7744-4beb-afb8-0378bd23a8a1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:46.804427 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-26213a28-7744-4beb-afb8-0378bd23a8a1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:46.804930 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-26213a28-7744-4beb-afb8-0378bd23a8a1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:46.805626 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-26213a28-7744-4beb-afb8-0378bd23a8a1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:46.806076 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-26213a28-7744-4beb-afb8-0378bd23a8a1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:46.806498 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-26213a28-7744-4beb-afb8-0378bd23a8a1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:46.910485 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-1f7bae5b-fb99-468b-8f40-2304c74c4e2c tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "DELETE /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 204 len: 0 microversion: 2.1 time: 0.299627 Oct 26 11:24:46.911286 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 368/725] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Oct 26 11:24:46 2022] DELETE /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 11:24:46.919552 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-824e362b-b21a-452d-b656-5c154ce9a6ea tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:46.920335 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-824e362b-b21a-452d-b656-5c154ce9a6ea tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:46.926811 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-824e362b-b21a-452d-b656-5c154ce9a6ea tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:46.932471 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-824e362b-b21a-452d-b656-5c154ce9a6ea tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:46.932471 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-824e362b-b21a-452d-b656-5c154ce9a6ea tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:46.932471 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-824e362b-b21a-452d-b656-5c154ce9a6ea tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:46.932471 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-824e362b-b21a-452d-b656-5c154ce9a6ea tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:46.932923 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-824e362b-b21a-452d-b656-5c154ce9a6ea tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:46.948260 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-26213a28-7744-4beb-afb8-0378bd23a8a1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:46.956053 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-26213a28-7744-4beb-afb8-0378bd23a8a1 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6" status: 200 len: 1266 microversion: 2.1 time: 0.162601 Oct 26 11:24:46.961036 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 358/726] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:46 2022] GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:24:47.160151 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-824e362b-b21a-452d-b656-5c154ce9a6ea tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:47.167705 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-824e362b-b21a-452d-b656-5c154ce9a6ea tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1689 microversion: 2.1 time: 0.252233 Oct 26 11:24:47.168277 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 369/727] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:46 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1689 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:24:47.460345 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-3f873278-efb3-426e-960e-4363c0e91153 req-7d5960f4-1c41-4753-82b5-2cfab10f7d9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "032aed92-2b14-4791-8612-a0261e6d77fd", "tag": "d48eea34-8900-4e01-bcd5-3b4a5f2f3dd1"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:24:47.469668 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-3f873278-efb3-426e-960e-4363c0e91153 req-7d5960f4-1c41-4753-82b5-2cfab10f7d9b service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:47.470142 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-3f873278-efb3-426e-960e-4363c0e91153 req-7d5960f4-1c41-4753-82b5-2cfab10f7d9b service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:47.471174 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-3f873278-efb3-426e-960e-4363c0e91153 req-7d5960f4-1c41-4753-82b5-2cfab10f7d9b service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:47.482139 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-3f873278-efb3-426e-960e-4363c0e91153 req-7d5960f4-1c41-4753-82b5-2cfab10f7d9b service nova] Creating event network-changed:d48eea34-8900-4e01-bcd5-3b4a5f2f3dd1 for instance 032aed92-2b14-4791-8612-a0261e6d77fd on hv-cinder-81558 Oct 26 11:24:47.487166 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-3f873278-efb3-426e-960e-4363c0e91153 req-7d5960f4-1c41-4753-82b5-2cfab10f7d9b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030242 Oct 26 11:24:47.488037 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 359/728] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:24:47.979489 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-8f94cc22-e2d4-40be-be6c-d4a6933b1d2c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:47.980149 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-8f94cc22-e2d4-40be-be6c-d4a6933b1d2c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 357ae7de-daf6-4dac-9370-1351f0fab0c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:47.987194 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8f94cc22-e2d4-40be-be6c-d4a6933b1d2c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:47.987683 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8f94cc22-e2d4-40be-be6c-d4a6933b1d2c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:47.988119 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8f94cc22-e2d4-40be-be6c-d4a6933b1d2c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:47.988817 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8f94cc22-e2d4-40be-be6c-d4a6933b1d2c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:47.989273 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8f94cc22-e2d4-40be-be6c-d4a6933b1d2c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:47.989700 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8f94cc22-e2d4-40be-be6c-d4a6933b1d2c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:48.122856 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-8f94cc22-e2d4-40be-be6c-d4a6933b1d2c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:48.131415 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-8f94cc22-e2d4-40be-be6c-d4a6933b1d2c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6" status: 200 len: 1266 microversion: 2.1 time: 0.155875 Oct 26 11:24:48.133146 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 370/729] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:47 2022] GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:48.190857 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-4ad50703-f748-4d4f-a11d-12a07e2cf8c5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:48.191567 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-4ad50703-f748-4d4f-a11d-12a07e2cf8c5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:48.197670 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4ad50703-f748-4d4f-a11d-12a07e2cf8c5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:48.198171 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4ad50703-f748-4d4f-a11d-12a07e2cf8c5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:48.198592 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4ad50703-f748-4d4f-a11d-12a07e2cf8c5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:48.199316 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4ad50703-f748-4d4f-a11d-12a07e2cf8c5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:48.199784 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4ad50703-f748-4d4f-a11d-12a07e2cf8c5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:48.200206 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4ad50703-f748-4d4f-a11d-12a07e2cf8c5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:48.583063 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-4ad50703-f748-4d4f-a11d-12a07e2cf8c5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:48.590799 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-4ad50703-f748-4d4f-a11d-12a07e2cf8c5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1689 microversion: 2.1 time: 0.404672 Oct 26 11:24:48.591492 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 360/730] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:48 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1689 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:49.155461 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e59eae75-7f0a-4278-99b0-b46ede30e21e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:49.156070 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-e59eae75-7f0a-4278-99b0-b46ede30e21e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 357ae7de-daf6-4dac-9370-1351f0fab0c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:49.163248 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e59eae75-7f0a-4278-99b0-b46ede30e21e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:49.163726 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e59eae75-7f0a-4278-99b0-b46ede30e21e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:49.164156 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e59eae75-7f0a-4278-99b0-b46ede30e21e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:49.164838 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e59eae75-7f0a-4278-99b0-b46ede30e21e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:49.165288 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e59eae75-7f0a-4278-99b0-b46ede30e21e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:49.165707 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e59eae75-7f0a-4278-99b0-b46ede30e21e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:49.293306 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-e59eae75-7f0a-4278-99b0-b46ede30e21e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:49.301508 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-e59eae75-7f0a-4278-99b0-b46ede30e21e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6" status: 200 len: 1266 microversion: 2.1 time: 0.149968 Oct 26 11:24:49.302113 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 371/731] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:49 2022] GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:49.613791 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-570cb118-5911-4cfb-9f83-0de2d1e92af0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:49.614434 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-570cb118-5911-4cfb-9f83-0de2d1e92af0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:49.620884 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-570cb118-5911-4cfb-9f83-0de2d1e92af0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:49.621370 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-570cb118-5911-4cfb-9f83-0de2d1e92af0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:49.621810 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-570cb118-5911-4cfb-9f83-0de2d1e92af0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:49.622501 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-570cb118-5911-4cfb-9f83-0de2d1e92af0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:49.622986 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-570cb118-5911-4cfb-9f83-0de2d1e92af0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:49.623414 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-570cb118-5911-4cfb-9f83-0de2d1e92af0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:49.749932 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-570cb118-5911-4cfb-9f83-0de2d1e92af0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:49.758116 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-570cb118-5911-4cfb-9f83-0de2d1e92af0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1689 microversion: 2.1 time: 0.148164 Oct 26 11:24:49.758682 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 361/732] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:49 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:50.324447 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-b9aeccbe-0e76-4dd2-90d8-e835f445380f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:50.325048 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-b9aeccbe-0e76-4dd2-90d8-e835f445380f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 357ae7de-daf6-4dac-9370-1351f0fab0c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:50.331881 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b9aeccbe-0e76-4dd2-90d8-e835f445380f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:50.332355 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b9aeccbe-0e76-4dd2-90d8-e835f445380f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:50.332782 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b9aeccbe-0e76-4dd2-90d8-e835f445380f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:50.333452 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b9aeccbe-0e76-4dd2-90d8-e835f445380f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:50.333902 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b9aeccbe-0e76-4dd2-90d8-e835f445380f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:50.334314 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b9aeccbe-0e76-4dd2-90d8-e835f445380f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:50.698666 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-b9aeccbe-0e76-4dd2-90d8-e835f445380f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:50.706248 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-b9aeccbe-0e76-4dd2-90d8-e835f445380f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6" status: 200 len: 1266 microversion: 2.1 time: 0.385608 Oct 26 11:24:50.707011 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 372/733] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:50 2022] GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6 => generated 1266 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:50.782055 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-f90df430-742d-4a2e-a46d-33624627af89 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:50.782721 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-f90df430-742d-4a2e-a46d-33624627af89 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:50.789301 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f90df430-742d-4a2e-a46d-33624627af89 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:50.789772 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f90df430-742d-4a2e-a46d-33624627af89 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:50.790207 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f90df430-742d-4a2e-a46d-33624627af89 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:50.790921 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f90df430-742d-4a2e-a46d-33624627af89 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:50.791373 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f90df430-742d-4a2e-a46d-33624627af89 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:50.791789 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f90df430-742d-4a2e-a46d-33624627af89 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:50.916343 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-f90df430-742d-4a2e-a46d-33624627af89 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:50.924467 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-f90df430-742d-4a2e-a46d-33624627af89 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1689 microversion: 2.1 time: 0.146282 Oct 26 11:24:50.925029 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 362/734] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:50 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1689 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:51.729541 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-756f414d-51c8-43ff-8360-c5ec5fb0847d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:51.730161 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-756f414d-51c8-43ff-8360-c5ec5fb0847d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 357ae7de-daf6-4dac-9370-1351f0fab0c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:51.736861 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-756f414d-51c8-43ff-8360-c5ec5fb0847d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:51.737434 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-756f414d-51c8-43ff-8360-c5ec5fb0847d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:51.738740 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-756f414d-51c8-43ff-8360-c5ec5fb0847d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:51.739803 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-756f414d-51c8-43ff-8360-c5ec5fb0847d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:51.740273 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-756f414d-51c8-43ff-8360-c5ec5fb0847d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:51.740700 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-756f414d-51c8-43ff-8360-c5ec5fb0847d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:51.947489 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-99e4732b-d0d2-4fb9-bffb-83180567a7b0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:51.948099 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-99e4732b-d0d2-4fb9-bffb-83180567a7b0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:51.955122 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-99e4732b-d0d2-4fb9-bffb-83180567a7b0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:51.955622 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-99e4732b-d0d2-4fb9-bffb-83180567a7b0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:51.956043 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-99e4732b-d0d2-4fb9-bffb-83180567a7b0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:51.956736 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-99e4732b-d0d2-4fb9-bffb-83180567a7b0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:51.957187 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-99e4732b-d0d2-4fb9-bffb-83180567a7b0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:51.957628 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-99e4732b-d0d2-4fb9-bffb-83180567a7b0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:51.966733 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-756f414d-51c8-43ff-8360-c5ec5fb0847d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:51.975485 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-756f414d-51c8-43ff-8360-c5ec5fb0847d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6" status: 200 len: 1266 microversion: 2.1 time: 0.249799 Oct 26 11:24:51.982352 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 373/735] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:51 2022] GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6 => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:52.088152 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-99e4732b-d0d2-4fb9-bffb-83180567a7b0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:52.096052 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-99e4732b-d0d2-4fb9-bffb-83180567a7b0 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1689 microversion: 2.1 time: 0.152811 Oct 26 11:24:52.096769 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 363/736] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:51 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:24:52.513929 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-083681ee-8cb7-43a3-90bf-b41c64e5cdde req-66c377e8-04f4-4c58-9abe-b67e0b299ecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "975e97a1-fe2c-4f81-88b5-274a052109c6", "name": "network-vif-deleted", "tag": "aa03144d-b19b-4e5d-8027-1ca2393de35d"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:24:52.523337 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-083681ee-8cb7-43a3-90bf-b41c64e5cdde req-66c377e8-04f4-4c58-9abe-b67e0b299ecb service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:52.524065 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-083681ee-8cb7-43a3-90bf-b41c64e5cdde req-66c377e8-04f4-4c58-9abe-b67e0b299ecb service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:52.530703 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-083681ee-8cb7-43a3-90bf-b41c64e5cdde req-66c377e8-04f4-4c58-9abe-b67e0b299ecb service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:52.535854 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-083681ee-8cb7-43a3-90bf-b41c64e5cdde req-66c377e8-04f4-4c58-9abe-b67e0b299ecb service nova] Creating event network-vif-deleted:aa03144d-b19b-4e5d-8027-1ca2393de35d for instance 975e97a1-fe2c-4f81-88b5-274a052109c6 on hv-cinder-81558 Oct 26 11:24:52.540741 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-083681ee-8cb7-43a3-90bf-b41c64e5cdde req-66c377e8-04f4-4c58-9abe-b67e0b299ecb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030578 Oct 26 11:24:52.541348 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 374/737] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:24:52.999704 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-12bbc986-82c2-480e-9559-f682474ce254 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:52.999704 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-12bbc986-82c2-480e-9559-f682474ce254 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 357ae7de-daf6-4dac-9370-1351f0fab0c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:53.005554 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-12bbc986-82c2-480e-9559-f682474ce254 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:53.006119 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-12bbc986-82c2-480e-9559-f682474ce254 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:53.006630 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-12bbc986-82c2-480e-9559-f682474ce254 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:53.007416 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-12bbc986-82c2-480e-9559-f682474ce254 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:53.008190 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-12bbc986-82c2-480e-9559-f682474ce254 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:53.008706 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-12bbc986-82c2-480e-9559-f682474ce254 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:53.120855 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-4ef16d1f-b753-47db-814d-c637b069f46f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:53.122223 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-4ef16d1f-b753-47db-814d-c637b069f46f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:53.129146 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4ef16d1f-b753-47db-814d-c637b069f46f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:53.129704 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4ef16d1f-b753-47db-814d-c637b069f46f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:53.130138 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4ef16d1f-b753-47db-814d-c637b069f46f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:53.130871 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4ef16d1f-b753-47db-814d-c637b069f46f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:53.131327 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4ef16d1f-b753-47db-814d-c637b069f46f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:53.131747 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4ef16d1f-b753-47db-814d-c637b069f46f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:53.161837 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-12bbc986-82c2-480e-9559-f682474ce254 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:53.171036 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-12bbc986-82c2-480e-9559-f682474ce254 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6" status: 200 len: 1266 microversion: 2.1 time: 0.176999 Oct 26 11:24:53.171630 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 364/738] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:52 2022] GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:53.187473 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4ef16d1f-b753-47db-814d-c637b069f46f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:53.188005 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4ef16d1f-b753-47db-814d-c637b069f46f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:53.188447 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4ef16d1f-b753-47db-814d-c637b069f46f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:53.188930 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.objects.instance [None req-4ef16d1f-b753-47db-814d-c637b069f46f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lazy-loading 'fault' on Instance uuid 975e97a1-fe2c-4f81-88b5-274a052109c6 {{(pid=119306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:24:53.232404 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-4ef16d1f-b753-47db-814d-c637b069f46f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:53.239937 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-4ef16d1f-b753-47db-814d-c637b069f46f tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 200 len: 1335 microversion: 2.1 time: 0.123977 Oct 26 11:24:53.240495 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 375/739] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:53 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 1335 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:54.194511 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a140cd74-943d-42a6-a629-12b8e58a2ff3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:54.195155 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-a140cd74-943d-42a6-a629-12b8e58a2ff3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 357ae7de-daf6-4dac-9370-1351f0fab0c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:54.201474 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a140cd74-943d-42a6-a629-12b8e58a2ff3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:54.201954 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a140cd74-943d-42a6-a629-12b8e58a2ff3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:54.202388 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a140cd74-943d-42a6-a629-12b8e58a2ff3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:54.203104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a140cd74-943d-42a6-a629-12b8e58a2ff3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:54.203557 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a140cd74-943d-42a6-a629-12b8e58a2ff3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:54.203980 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a140cd74-943d-42a6-a629-12b8e58a2ff3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:54.262679 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-c6bade4a-4916-4cba-9629-64200c594099 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:54.263319 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-c6bade4a-4916-4cba-9629-64200c594099 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: 975e97a1-fe2c-4f81-88b5-274a052109c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:54.269778 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c6bade4a-4916-4cba-9629-64200c594099 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:54.270373 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c6bade4a-4916-4cba-9629-64200c594099 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:54.270928 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c6bade4a-4916-4cba-9629-64200c594099 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:54.271620 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c6bade4a-4916-4cba-9629-64200c594099 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:54.272073 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c6bade4a-4916-4cba-9629-64200c594099 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:54.272493 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c6bade4a-4916-4cba-9629-64200c594099 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:54.286502 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.wsgi [None req-c6bade4a-4916-4cba-9629-64200c594099 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] HTTP exception thrown: Instance 975e97a1-fe2c-4f81-88b5-274a052109c6 could not be found. Oct 26 11:24:54.288364 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-c6bade4a-4916-4cba-9629-64200c594099 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Request method failure captured: Oct 26 11:24:54.288364 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: request: GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 HTTP/1.1 Oct 26 11:24:54.288364 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept: application/json Oct 26 11:24:54.288364 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept-Encoding: identity Oct 26 11:24:54.288364 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Connection: close Oct 26 11:24:54.288364 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Length: 0 Oct 26 11:24:54.288364 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Type: application/json Oct 26 11:24:54.288364 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Host: 10.222.0.42 Oct 26 11:24:54.288364 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Openstack-System-Scope: None Oct 26 11:24:54.288364 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: User-Agent: python-urllib3/1.26.12 Oct 26 11:24:54.288364 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Auth-Token: gAAAAABjWRd40WLM7XlbrGPbRw18F96uIOfpp8NDITvfojHp3EyOTvndi67r1Fha0TOXdoTqce01i5ZheMOxUzOr8ymSH94zV3s0kkFIS65f_eWJ6teUfzHgs74JxT0RZTqA8nleV0r2Q_qChfss6AyzzJ4qh4wmZHWc0a-DEdFXeuuJ2u8f3Og Oct 26 11:24:54.288364 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Id: None Oct 26 11:24:54.288364 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Name: None Oct 26 11:24:54.288364 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Identity-Status: Confirmed Oct 26 11:24:54.288364 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Is-Admin-Project: True Oct 26 11:24:54.288364 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Id: default Oct 26 11:24:54.288364 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Name: Default Oct 26 11:24:54.288364 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Id: 9d9d2ce62fb74bdb8de53bc06b1a999d Oct 26 11:24:54.288364 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1384722553 Oct 26 11:24:54.288364 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Role: member,reader Oct 26 11:24:54.288364 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Roles: member,reader Oct 26 11:24:54.289938 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d9d2ce62fb74bdb8de53bc06b1a999d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d9d2ce62fb74bdb8de53bc06b1a999d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d9d2ce62fb74bdb8de53bc06b1a999d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d9d2ce62fb74bdb8de53bc06b1a999d"}]}] Oct 26 11:24:54.289938 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1384722553 Oct 26 11:24:54.289938 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Id: 9d9d2ce62fb74bdb8de53bc06b1a999d Oct 26 11:24:54.289938 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1384722553 Oct 26 11:24:54.289938 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User: tempest-ServerRescueNegativeTestJSON-1384722553-project Oct 26 11:24:54.289938 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Id: default Oct 26 11:24:54.289938 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Name: Default Oct 26 11:24:54.289938 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Id: ff0c5f8521534fc1a0a9c5ea28fbaac1 Oct 26 11:24:54.289938 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1384722553-project Oct 26 11:24:54.289938 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: method: > Oct 26 11:24:54.289938 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: exception: Instance 975e97a1-fe2c-4f81-88b5-274a052109c6 could not be found. Oct 26 11:24:54.289938 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: action_args: {'id': '975e97a1-fe2c-4f81-88b5-274a052109c6'} Oct 26 11:24:54.293828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:24:54.293828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:24:54.293828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:24:54.293828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:24:54.293828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:24:54.293828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:24:54.293828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:24:54.293828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:24:54.293828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:24:54.293828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:24:54.293828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 975e97a1-fe2c-4f81-88b5-274a052109c6 could not be found. Oct 26 11:24:54.293828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:24:54.293828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:24:54.293828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:24:54.293828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:24:54.293828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:24:54.293828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:24:54.293828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:24:54.293828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:24:54.293828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:24:54.295393 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:24:54.295393 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 11:24:54.295393 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 11:24:54.295393 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:24:54.295393 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:24:54.295393 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:24:54.295393 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:24:54.295393 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 975e97a1-fe2c-4f81-88b5-274a052109c6 could not be found. Oct 26 11:24:54.295393 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:24:54.295393 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:24:54.295393 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:24:54.295393 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:24:54.295393 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:24:54.295393 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:24:54.295393 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:24:54.295393 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:24:54.295393 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 975e97a1-fe2c-4f81-88b5-274a052109c6 could not be found. Oct 26 11:24:54.295393 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:24:54.296775 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-c6bade4a-4916-4cba-9629-64200c594099 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Returning 404 to user: Instance 975e97a1-fe2c-4f81-88b5-274a052109c6 could not be found. {{(pid=119306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:24:54.296775 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-c6bade4a-4916-4cba-9629-64200c594099 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6" status: 404 len: 111 microversion: 2.1 time: 0.030932 Oct 26 11:24:54.296775 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 376/740] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:54 2022] GET /compute/v2.1/servers/975e97a1-fe2c-4f81-88b5-274a052109c6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 11:24:54.298785 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-d7dda5d1-a991-462f-bc25-8824187914ed tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '.version_select at 0x7f6b936919d0>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:54.332271 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-a140cd74-943d-42a6-a629-12b8e58a2ff3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:54.340074 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-a140cd74-943d-42a6-a629-12b8e58a2ff3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6" status: 200 len: 1266 microversion: 2.1 time: 0.149371 Oct 26 11:24:54.340672 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 365/741] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:54 2022] GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:54.362506 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-d7dda5d1-a991-462f-bc25-8824187914ed tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-470444218" status: 202 len: 0 microversion: 2.1 time: 0.068062 Oct 26 11:24:54.363141 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 377/742] 10.222.0.42 () {58 vars in 1218 bytes} [Wed Oct 26 11:24:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-470444218 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 26 11:24:55.064998 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-7e9ea43b-ca92-4e8a-935a-518b11d6c64c req-1d6ce483-08e5-4642-a253-9928e189e126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "357ae7de-daf6-4dac-9370-1351f0fab0c6", "name": "network-vif-plugged", "status": "completed", "tag": "4098a34c-ed38-40c7-a957-cd9dc982a278"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:24:55.070752 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-7e9ea43b-ca92-4e8a-935a-518b11d6c64c req-1d6ce483-08e5-4642-a253-9928e189e126 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:55.071260 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-7e9ea43b-ca92-4e8a-935a-518b11d6c64c req-1d6ce483-08e5-4642-a253-9928e189e126 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:55.071682 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-7e9ea43b-ca92-4e8a-935a-518b11d6c64c req-1d6ce483-08e5-4642-a253-9928e189e126 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:55.087415 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-7e9ea43b-ca92-4e8a-935a-518b11d6c64c req-1d6ce483-08e5-4642-a253-9928e189e126 service nova] Creating event network-vif-plugged:4098a34c-ed38-40c7-a957-cd9dc982a278 for instance 357ae7de-daf6-4dac-9370-1351f0fab0c6 on hv-cinder-81558 Oct 26 11:24:55.087815 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-7e9ea43b-ca92-4e8a-935a-518b11d6c64c req-1d6ce483-08e5-4642-a253-9928e189e126 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030147 Oct 26 11:24:55.088451 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 366/743] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:24:55.364643 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-7a2115e2-42f5-4ced-91c6-751cf777609d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:55.365261 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-7a2115e2-42f5-4ced-91c6-751cf777609d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 357ae7de-daf6-4dac-9370-1351f0fab0c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:55.371924 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7a2115e2-42f5-4ced-91c6-751cf777609d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:55.372412 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7a2115e2-42f5-4ced-91c6-751cf777609d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:55.372850 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7a2115e2-42f5-4ced-91c6-751cf777609d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:55.373556 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7a2115e2-42f5-4ced-91c6-751cf777609d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:55.373996 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7a2115e2-42f5-4ced-91c6-751cf777609d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:55.374421 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7a2115e2-42f5-4ced-91c6-751cf777609d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:55.504983 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-7a2115e2-42f5-4ced-91c6-751cf777609d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:55.512742 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-7a2115e2-42f5-4ced-91c6-751cf777609d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6" status: 200 len: 1266 microversion: 2.1 time: 0.153191 Oct 26 11:24:55.513432 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 378/744] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:55 2022] GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:56.537969 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-3b975b78-201d-4027-bbcb-73667476ac18 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:56.538617 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-3b975b78-201d-4027-bbcb-73667476ac18 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 357ae7de-daf6-4dac-9370-1351f0fab0c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:56.544605 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3b975b78-201d-4027-bbcb-73667476ac18 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:56.545082 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3b975b78-201d-4027-bbcb-73667476ac18 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:56.545509 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3b975b78-201d-4027-bbcb-73667476ac18 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:56.546188 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3b975b78-201d-4027-bbcb-73667476ac18 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:56.546635 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3b975b78-201d-4027-bbcb-73667476ac18 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:56.547073 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3b975b78-201d-4027-bbcb-73667476ac18 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:56.677699 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-3b975b78-201d-4027-bbcb-73667476ac18 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:56.685174 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-3b975b78-201d-4027-bbcb-73667476ac18 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6" status: 200 len: 1266 microversion: 2.1 time: 0.152015 Oct 26 11:24:56.685768 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 367/745] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:56 2022] GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:57.511222 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-bd2cf697-2a9f-4a7b-9b36-9410210d50a4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:57.511718 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-bd2cf697-2a9f-4a7b-9b36-9410210d50a4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:57.518101 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bd2cf697-2a9f-4a7b-9b36-9410210d50a4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:57.518579 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bd2cf697-2a9f-4a7b-9b36-9410210d50a4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:57.519047 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bd2cf697-2a9f-4a7b-9b36-9410210d50a4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:57.519733 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bd2cf697-2a9f-4a7b-9b36-9410210d50a4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:57.520187 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bd2cf697-2a9f-4a7b-9b36-9410210d50a4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:57.520852 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bd2cf697-2a9f-4a7b-9b36-9410210d50a4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:57.545673 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-bd2cf697-2a9f-4a7b-9b36-9410210d50a4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Going to try to terminate instance {{(pid=119306) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 11:24:57.708620 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-7ac7072c-75e9-4aa8-aa3a-1a1c2a481552 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:57.709165 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-7ac7072c-75e9-4aa8-aa3a-1a1c2a481552 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 357ae7de-daf6-4dac-9370-1351f0fab0c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:57.715412 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7ac7072c-75e9-4aa8-aa3a-1a1c2a481552 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:57.715905 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7ac7072c-75e9-4aa8-aa3a-1a1c2a481552 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:57.720240 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7ac7072c-75e9-4aa8-aa3a-1a1c2a481552 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:57.720240 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7ac7072c-75e9-4aa8-aa3a-1a1c2a481552 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:57.720240 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7ac7072c-75e9-4aa8-aa3a-1a1c2a481552 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:57.720240 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7ac7072c-75e9-4aa8-aa3a-1a1c2a481552 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:57.806471 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-bd2cf697-2a9f-4a7b-9b36-9410210d50a4 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 204 len: 0 microversion: 2.1 time: 0.298775 Oct 26 11:24:57.807104 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 379/746] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Oct 26 11:24:57 2022] DELETE /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 11:24:57.815486 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-35f72ab5-64a8-4f2f-8335-71ff2d4d0f93 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:57.816181 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-35f72ab5-64a8-4f2f-8335-71ff2d4d0f93 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:57.822148 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-35f72ab5-64a8-4f2f-8335-71ff2d4d0f93 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:57.822638 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-35f72ab5-64a8-4f2f-8335-71ff2d4d0f93 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:57.823099 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-35f72ab5-64a8-4f2f-8335-71ff2d4d0f93 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:57.824034 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-35f72ab5-64a8-4f2f-8335-71ff2d4d0f93 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:57.824485 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-35f72ab5-64a8-4f2f-8335-71ff2d4d0f93 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:57.824905 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-35f72ab5-64a8-4f2f-8335-71ff2d4d0f93 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:57.861331 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-7ac7072c-75e9-4aa8-aa3a-1a1c2a481552 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:57.865551 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-7ac7072c-75e9-4aa8-aa3a-1a1c2a481552 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6" status: 200 len: 1454 microversion: 2.1 time: 0.161492 Oct 26 11:24:57.866351 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 368/747] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:57 2022] GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6 => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:24:57.887509 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-b0ac46a2-5970-442c-9d12-21842f5fd44b tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:57.889560 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-b0ac46a2-5970-442c-9d12-21842f5fd44b tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 357ae7de-daf6-4dac-9370-1351f0fab0c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:57.894560 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b0ac46a2-5970-442c-9d12-21842f5fd44b tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:57.895327 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b0ac46a2-5970-442c-9d12-21842f5fd44b tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:57.895981 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b0ac46a2-5970-442c-9d12-21842f5fd44b tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:57.896820 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b0ac46a2-5970-442c-9d12-21842f5fd44b tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:57.897443 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b0ac46a2-5970-442c-9d12-21842f5fd44b tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:57.898189 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b0ac46a2-5970-442c-9d12-21842f5fd44b tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:57.961395 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-35f72ab5-64a8-4f2f-8335-71ff2d4d0f93 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:57.969087 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-35f72ab5-64a8-4f2f-8335-71ff2d4d0f93 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1508 microversion: 2.1 time: 0.157742 Oct 26 11:24:57.970226 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 380/748] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:57 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:58.027611 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-b0ac46a2-5970-442c-9d12-21842f5fd44b tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:58.035250 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-b0ac46a2-5970-442c-9d12-21842f5fd44b tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6" status: 200 len: 1454 microversion: 2.1 time: 0.151493 Oct 26 11:24:58.035820 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 369/749] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:57 2022] GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:24:58.992429 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e9d08ec1-8645-47b9-a617-74f692a2a0f5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:24:58.993042 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-e9d08ec1-8645-47b9-a617-74f692a2a0f5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:24:58.999555 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e9d08ec1-8645-47b9-a617-74f692a2a0f5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:59.000039 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e9d08ec1-8645-47b9-a617-74f692a2a0f5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:59.000476 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e9d08ec1-8645-47b9-a617-74f692a2a0f5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:59.001662 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e9d08ec1-8645-47b9-a617-74f692a2a0f5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:59.002114 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e9d08ec1-8645-47b9-a617-74f692a2a0f5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:59.002537 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e9d08ec1-8645-47b9-a617-74f692a2a0f5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:59.289941 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-e9d08ec1-8645-47b9-a617-74f692a2a0f5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:24:59.298163 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-e9d08ec1-8645-47b9-a617-74f692a2a0f5 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1508 microversion: 2.1 time: 0.309100 Oct 26 11:24:59.298997 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 381/750] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:24:58 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1508 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:24:59.801086 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-27893211-ed4e-4f0c-b146-0c574ebf015c req-e130497e-eb75-4bb5-87ce-bc34e0985d14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3d343d6-fcf5-4a1b-a077-d2e28d613a70", "name": "network-vif-deleted", "tag": "0bd9ab45-c3f2-4623-8bcc-0d43ada4210e"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:24:59.815888 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-27893211-ed4e-4f0c-b146-0c574ebf015c req-e130497e-eb75-4bb5-87ce-bc34e0985d14 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:24:59.816442 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-27893211-ed4e-4f0c-b146-0c574ebf015c req-e130497e-eb75-4bb5-87ce-bc34e0985d14 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:24:59.817240 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-27893211-ed4e-4f0c-b146-0c574ebf015c req-e130497e-eb75-4bb5-87ce-bc34e0985d14 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:24:59.829213 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-27893211-ed4e-4f0c-b146-0c574ebf015c req-e130497e-eb75-4bb5-87ce-bc34e0985d14 service nova] Creating event network-vif-deleted:0bd9ab45-c3f2-4623-8bcc-0d43ada4210e for instance f3d343d6-fcf5-4a1b-a077-d2e28d613a70 on hv-cinder-81558 Oct 26 11:24:59.834393 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-27893211-ed4e-4f0c-b146-0c574ebf015c req-e130497e-eb75-4bb5-87ce-bc34e0985d14 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037788 Oct 26 11:24:59.835250 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 370/751] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:25:00.320254 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e2e369c1-28ed-4503-ba50-09930dd871ff tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:25:00.321049 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-e2e369c1-28ed-4503-ba50-09930dd871ff tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:25:00.327957 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2e369c1-28ed-4503-ba50-09930dd871ff tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:25:00.328379 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2e369c1-28ed-4503-ba50-09930dd871ff tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:25:00.329659 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2e369c1-28ed-4503-ba50-09930dd871ff tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:25:00.330407 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2e369c1-28ed-4503-ba50-09930dd871ff tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:25:00.330885 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2e369c1-28ed-4503-ba50-09930dd871ff tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:25:00.331655 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2e369c1-28ed-4503-ba50-09930dd871ff tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:25:00.363916 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2e369c1-28ed-4503-ba50-09930dd871ff tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:25:00.364397 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2e369c1-28ed-4503-ba50-09930dd871ff tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:25:00.364828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2e369c1-28ed-4503-ba50-09930dd871ff tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:25:00.365378 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.objects.instance [None req-e2e369c1-28ed-4503-ba50-09930dd871ff tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lazy-loading 'fault' on Instance uuid f3d343d6-fcf5-4a1b-a077-d2e28d613a70 {{(pid=119306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:25:00.368184 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:25:00.423419 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-e2e369c1-28ed-4503-ba50-09930dd871ff tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:25:00.430904 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-e2e369c1-28ed-4503-ba50-09930dd871ff tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 200 len: 1312 microversion: 2.1 time: 0.114498 Oct 26 11:25:00.431473 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 382/752] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:25:00 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 1312 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:25:01.455341 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-5f0db199-96ac-4dab-8f7b-0aae8bf3c3d2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:25:01.456063 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-5f0db199-96ac-4dab-8f7b-0aae8bf3c3d2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f3d343d6-fcf5-4a1b-a077-d2e28d613a70] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:25:01.462276 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5f0db199-96ac-4dab-8f7b-0aae8bf3c3d2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:25:01.462756 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5f0db199-96ac-4dab-8f7b-0aae8bf3c3d2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:25:01.463218 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5f0db199-96ac-4dab-8f7b-0aae8bf3c3d2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:25:01.463899 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5f0db199-96ac-4dab-8f7b-0aae8bf3c3d2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:25:01.464347 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5f0db199-96ac-4dab-8f7b-0aae8bf3c3d2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:25:01.464767 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5f0db199-96ac-4dab-8f7b-0aae8bf3c3d2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:25:01.478397 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.wsgi [None req-5f0db199-96ac-4dab-8f7b-0aae8bf3c3d2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] HTTP exception thrown: Instance f3d343d6-fcf5-4a1b-a077-d2e28d613a70 could not be found. Oct 26 11:25:01.486714 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-5f0db199-96ac-4dab-8f7b-0aae8bf3c3d2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Request method failure captured: Oct 26 11:25:01.486714 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: request: GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 HTTP/1.1 Oct 26 11:25:01.486714 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept: application/json Oct 26 11:25:01.486714 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept-Encoding: identity Oct 26 11:25:01.486714 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Connection: close Oct 26 11:25:01.486714 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Length: 0 Oct 26 11:25:01.486714 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Type: application/json Oct 26 11:25:01.486714 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Host: 10.222.0.42 Oct 26 11:25:01.486714 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Openstack-System-Scope: None Oct 26 11:25:01.486714 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: User-Agent: python-urllib3/1.26.12 Oct 26 11:25:01.486714 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Auth-Token: gAAAAABjWRd40WLM7XlbrGPbRw18F96uIOfpp8NDITvfojHp3EyOTvndi67r1Fha0TOXdoTqce01i5ZheMOxUzOr8ymSH94zV3s0kkFIS65f_eWJ6teUfzHgs74JxT0RZTqA8nleV0r2Q_qChfss6AyzzJ4qh4wmZHWc0a-DEdFXeuuJ2u8f3Og Oct 26 11:25:01.486714 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Id: None Oct 26 11:25:01.486714 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Name: None Oct 26 11:25:01.486714 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Identity-Status: Confirmed Oct 26 11:25:01.486714 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Is-Admin-Project: True Oct 26 11:25:01.486714 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Id: default Oct 26 11:25:01.486714 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Name: Default Oct 26 11:25:01.486714 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Id: 9d9d2ce62fb74bdb8de53bc06b1a999d Oct 26 11:25:01.486714 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1384722553 Oct 26 11:25:01.486714 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Role: member,reader Oct 26 11:25:01.486714 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Roles: member,reader Oct 26 11:25:01.488412 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d9d2ce62fb74bdb8de53bc06b1a999d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d9d2ce62fb74bdb8de53bc06b1a999d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d9d2ce62fb74bdb8de53bc06b1a999d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d9d2ce62fb74bdb8de53bc06b1a999d"}]}] Oct 26 11:25:01.488412 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1384722553 Oct 26 11:25:01.488412 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Id: 9d9d2ce62fb74bdb8de53bc06b1a999d Oct 26 11:25:01.488412 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1384722553 Oct 26 11:25:01.488412 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User: tempest-ServerRescueNegativeTestJSON-1384722553-project Oct 26 11:25:01.488412 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Id: default Oct 26 11:25:01.488412 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Name: Default Oct 26 11:25:01.488412 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Id: ff0c5f8521534fc1a0a9c5ea28fbaac1 Oct 26 11:25:01.488412 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1384722553-project Oct 26 11:25:01.488412 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: method: > Oct 26 11:25:01.488412 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: exception: Instance f3d343d6-fcf5-4a1b-a077-d2e28d613a70 could not be found. Oct 26 11:25:01.488412 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: action_args: {'id': 'f3d343d6-fcf5-4a1b-a077-d2e28d613a70'} Oct 26 11:25:01.489388 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:25:01.489388 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:25:01.489388 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:25:01.489388 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:25:01.489388 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:25:01.489388 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:25:01.489388 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:25:01.489388 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:25:01.489388 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:25:01.489388 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:25:01.489388 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3d343d6-fcf5-4a1b-a077-d2e28d613a70 could not be found. Oct 26 11:25:01.489388 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:25:01.489388 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:25:01.489388 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:25:01.489388 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:25:01.489388 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:25:01.489388 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:25:01.489388 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:25:01.489388 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:25:01.489388 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:25:01.490850 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:25:01.490850 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 11:25:01.490850 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 11:25:01.490850 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:25:01.490850 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:25:01.490850 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:25:01.490850 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:25:01.490850 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3d343d6-fcf5-4a1b-a077-d2e28d613a70 could not be found. Oct 26 11:25:01.490850 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:25:01.490850 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:25:01.490850 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:25:01.490850 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:25:01.490850 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:25:01.490850 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:25:01.490850 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:25:01.490850 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:25:01.490850 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3d343d6-fcf5-4a1b-a077-d2e28d613a70 could not be found. Oct 26 11:25:01.490850 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:25:01.492164 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-5f0db199-96ac-4dab-8f7b-0aae8bf3c3d2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Returning 404 to user: Instance f3d343d6-fcf5-4a1b-a077-d2e28d613a70 could not be found. {{(pid=119305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:25:01.492164 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-5f0db199-96ac-4dab-8f7b-0aae8bf3c3d2 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70" status: 404 len: 111 microversion: 2.1 time: 0.031523 Oct 26 11:25:01.492164 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 371/753] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:25:01 2022] GET /compute/v2.1/servers/f3d343d6-fcf5-4a1b-a077-d2e28d613a70 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:25:01.492466 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-9a097966-4ae8-43c6-bc7c-b785b51bb087 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:25:01.492466 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-9a097966-4ae8-43c6-bc7c-b785b51bb087 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:25:01.497297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9a097966-4ae8-43c6-bc7c-b785b51bb087 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:25:01.497780 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9a097966-4ae8-43c6-bc7c-b785b51bb087 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:25:01.498215 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9a097966-4ae8-43c6-bc7c-b785b51bb087 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:25:01.499224 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9a097966-4ae8-43c6-bc7c-b785b51bb087 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:25:01.499410 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9a097966-4ae8-43c6-bc7c-b785b51bb087 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:25:01.499781 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9a097966-4ae8-43c6-bc7c-b785b51bb087 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:25:01.528136 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-9a097966-4ae8-43c6-bc7c-b785b51bb087 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Going to try to terminate instance {{(pid=119306) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 11:25:01.760570 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-9a097966-4ae8-43c6-bc7c-b785b51bb087 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 204 len: 0 microversion: 2.1 time: 0.274367 Oct 26 11:25:01.767087 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 383/754] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Oct 26 11:25:01 2022] DELETE /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 11:25:01.769890 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-4671bd06-1730-4e12-b868-7718a8e1be7d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:25:01.770494 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-4671bd06-1730-4e12-b868-7718a8e1be7d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:25:01.776921 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4671bd06-1730-4e12-b868-7718a8e1be7d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:25:01.777403 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4671bd06-1730-4e12-b868-7718a8e1be7d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:25:01.777954 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4671bd06-1730-4e12-b868-7718a8e1be7d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:25:01.778635 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4671bd06-1730-4e12-b868-7718a8e1be7d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:25:01.779110 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4671bd06-1730-4e12-b868-7718a8e1be7d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:25:01.779536 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4671bd06-1730-4e12-b868-7718a8e1be7d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:25:01.851804 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-94e3a117-c3e7-4612-84ae-d033aea29ce8 req-a433c113-a1b8-495f-a6f0-257d61747d5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "357ae7de-daf6-4dac-9370-1351f0fab0c6", "tag": "4098a34c-ed38-40c7-a957-cd9dc982a278"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:25:01.862401 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-94e3a117-c3e7-4612-84ae-d033aea29ce8 req-a433c113-a1b8-495f-a6f0-257d61747d5d service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:25:01.862919 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-94e3a117-c3e7-4612-84ae-d033aea29ce8 req-a433c113-a1b8-495f-a6f0-257d61747d5d service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:25:01.863346 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-94e3a117-c3e7-4612-84ae-d033aea29ce8 req-a433c113-a1b8-495f-a6f0-257d61747d5d service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:25:01.879991 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-94e3a117-c3e7-4612-84ae-d033aea29ce8 req-a433c113-a1b8-495f-a6f0-257d61747d5d service nova] Creating event network-changed:4098a34c-ed38-40c7-a957-cd9dc982a278 for instance 357ae7de-daf6-4dac-9370-1351f0fab0c6 on hv-cinder-81558 Oct 26 11:25:01.885012 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-94e3a117-c3e7-4612-84ae-d033aea29ce8 req-a433c113-a1b8-495f-a6f0-257d61747d5d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037530 Oct 26 11:25:01.885788 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 384/755] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:25:01.920307 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-4671bd06-1730-4e12-b868-7718a8e1be7d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:25:01.928445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-4671bd06-1730-4e12-b868-7718a8e1be7d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1522 microversion: 2.1 time: 0.163115 Oct 26 11:25:01.929050 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 372/756] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:25:01 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:25:02.952610 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-776aed97-3556-4025-8c59-1f96a80e824e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:25:02.953299 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-776aed97-3556-4025-8c59-1f96a80e824e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:25:02.960814 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-776aed97-3556-4025-8c59-1f96a80e824e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:25:02.961296 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-776aed97-3556-4025-8c59-1f96a80e824e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:25:02.961726 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-776aed97-3556-4025-8c59-1f96a80e824e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:25:02.962421 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-776aed97-3556-4025-8c59-1f96a80e824e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:25:02.962890 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-776aed97-3556-4025-8c59-1f96a80e824e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:25:02.963308 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-776aed97-3556-4025-8c59-1f96a80e824e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:25:03.095165 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-776aed97-3556-4025-8c59-1f96a80e824e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:25:03.103042 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-776aed97-3556-4025-8c59-1f96a80e824e tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1522 microversion: 2.1 time: 0.154627 Oct 26 11:25:03.103621 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 385/757] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:25:02 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:25:04.125875 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-323fda08-1f09-4ec4-b475-8fe5e3d4424d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:25:04.126730 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-323fda08-1f09-4ec4-b475-8fe5e3d4424d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:25:04.133955 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-323fda08-1f09-4ec4-b475-8fe5e3d4424d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:25:04.134518 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-323fda08-1f09-4ec4-b475-8fe5e3d4424d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:25:04.135067 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-323fda08-1f09-4ec4-b475-8fe5e3d4424d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:25:04.135835 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-323fda08-1f09-4ec4-b475-8fe5e3d4424d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:25:04.136386 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-323fda08-1f09-4ec4-b475-8fe5e3d4424d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:25:04.136885 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-323fda08-1f09-4ec4-b475-8fe5e3d4424d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:25:04.360966 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-323fda08-1f09-4ec4-b475-8fe5e3d4424d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:25:04.368550 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-323fda08-1f09-4ec4-b475-8fe5e3d4424d tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1522 microversion: 2.1 time: 0.246559 Oct 26 11:25:04.369114 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 373/758] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:25:04 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:25:04.640226 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-4bcf3f6e-c4a2-489c-bd34-c6ea5788fff4 req-0b5cc9d8-e646-4d95-bcf2-ca6fbb2bf099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f70dba-88ab-42ae-ace7-b95eeac5fcfc", "name": "network-vif-deleted", "tag": "9710ecc2-ca47-4ec2-84c2-3aadb85ac335"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:25:04.651422 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-4bcf3f6e-c4a2-489c-bd34-c6ea5788fff4 req-0b5cc9d8-e646-4d95-bcf2-ca6fbb2bf099 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:25:04.651903 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-4bcf3f6e-c4a2-489c-bd34-c6ea5788fff4 req-0b5cc9d8-e646-4d95-bcf2-ca6fbb2bf099 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:25:04.652345 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-4bcf3f6e-c4a2-489c-bd34-c6ea5788fff4 req-0b5cc9d8-e646-4d95-bcf2-ca6fbb2bf099 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:25:04.664472 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-4bcf3f6e-c4a2-489c-bd34-c6ea5788fff4 req-0b5cc9d8-e646-4d95-bcf2-ca6fbb2bf099 service nova] Creating event network-vif-deleted:9710ecc2-ca47-4ec2-84c2-3aadb85ac335 for instance f2f70dba-88ab-42ae-ace7-b95eeac5fcfc on hv-cinder-81558 Oct 26 11:25:04.669304 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-4bcf3f6e-c4a2-489c-bd34-c6ea5788fff4 req-0b5cc9d8-e646-4d95-bcf2-ca6fbb2bf099 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032755 Oct 26 11:25:04.670395 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 386/759] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:25:05.391754 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-d61cd4b0-5085-42cb-8253-eea30e35d4c8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:25:05.392493 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-d61cd4b0-5085-42cb-8253-eea30e35d4c8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:25:05.399156 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d61cd4b0-5085-42cb-8253-eea30e35d4c8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:25:05.399639 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d61cd4b0-5085-42cb-8253-eea30e35d4c8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:25:05.400077 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d61cd4b0-5085-42cb-8253-eea30e35d4c8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:25:05.400770 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d61cd4b0-5085-42cb-8253-eea30e35d4c8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:25:05.401222 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d61cd4b0-5085-42cb-8253-eea30e35d4c8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:25:05.401645 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d61cd4b0-5085-42cb-8253-eea30e35d4c8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:25:05.431687 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d61cd4b0-5085-42cb-8253-eea30e35d4c8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:25:05.432164 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d61cd4b0-5085-42cb-8253-eea30e35d4c8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:25:05.432595 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d61cd4b0-5085-42cb-8253-eea30e35d4c8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:25:05.433032 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.objects.instance [None req-d61cd4b0-5085-42cb-8253-eea30e35d4c8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lazy-loading 'fault' on Instance uuid f2f70dba-88ab-42ae-ace7-b95eeac5fcfc {{(pid=119305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:25:05.474147 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-d61cd4b0-5085-42cb-8253-eea30e35d4c8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0c5f8521534fc1a0a9c5ea28fbaac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d9d2ce62fb74bdb8de53bc06b1a999d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:25:05.481720 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-d61cd4b0-5085-42cb-8253-eea30e35d4c8 tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 200 len: 1311 microversion: 2.1 time: 0.093891 Oct 26 11:25:05.482280 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 374/760] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:25:05 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 1311 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:25:06.506191 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-3cb9d186-7a1d-493a-a2fd-60b107c2babb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:25:06.506995 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-3cb9d186-7a1d-493a-a2fd-60b107c2babb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] [instance: f2f70dba-88ab-42ae-ace7-b95eeac5fcfc] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:25:06.508902 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:25:06.513704 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3cb9d186-7a1d-493a-a2fd-60b107c2babb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:25:06.514185 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3cb9d186-7a1d-493a-a2fd-60b107c2babb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:25:06.514623 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3cb9d186-7a1d-493a-a2fd-60b107c2babb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:25:06.515341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3cb9d186-7a1d-493a-a2fd-60b107c2babb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:25:06.515798 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3cb9d186-7a1d-493a-a2fd-60b107c2babb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:25:06.516223 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3cb9d186-7a1d-493a-a2fd-60b107c2babb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:25:06.532078 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.wsgi [None req-3cb9d186-7a1d-493a-a2fd-60b107c2babb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] HTTP exception thrown: Instance f2f70dba-88ab-42ae-ace7-b95eeac5fcfc could not be found. Oct 26 11:25:06.536548 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-3cb9d186-7a1d-493a-a2fd-60b107c2babb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Request method failure captured: Oct 26 11:25:06.536548 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: request: GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc HTTP/1.1 Oct 26 11:25:06.536548 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept: application/json Oct 26 11:25:06.536548 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept-Encoding: identity Oct 26 11:25:06.536548 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Connection: close Oct 26 11:25:06.536548 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Length: 0 Oct 26 11:25:06.536548 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Type: application/json Oct 26 11:25:06.536548 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Host: 10.222.0.42 Oct 26 11:25:06.536548 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Openstack-System-Scope: None Oct 26 11:25:06.536548 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: User-Agent: python-urllib3/1.26.12 Oct 26 11:25:06.536548 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Auth-Token: gAAAAABjWRd40WLM7XlbrGPbRw18F96uIOfpp8NDITvfojHp3EyOTvndi67r1Fha0TOXdoTqce01i5ZheMOxUzOr8ymSH94zV3s0kkFIS65f_eWJ6teUfzHgs74JxT0RZTqA8nleV0r2Q_qChfss6AyzzJ4qh4wmZHWc0a-DEdFXeuuJ2u8f3Og Oct 26 11:25:06.536548 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Id: None Oct 26 11:25:06.536548 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Name: None Oct 26 11:25:06.536548 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Identity-Status: Confirmed Oct 26 11:25:06.536548 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Is-Admin-Project: True Oct 26 11:25:06.536548 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Id: default Oct 26 11:25:06.536548 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Name: Default Oct 26 11:25:06.536548 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Id: 9d9d2ce62fb74bdb8de53bc06b1a999d Oct 26 11:25:06.536548 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1384722553 Oct 26 11:25:06.536548 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Role: member,reader Oct 26 11:25:06.536548 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Roles: member,reader Oct 26 11:25:06.538049 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d9d2ce62fb74bdb8de53bc06b1a999d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d9d2ce62fb74bdb8de53bc06b1a999d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d9d2ce62fb74bdb8de53bc06b1a999d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d9d2ce62fb74bdb8de53bc06b1a999d"}]}] Oct 26 11:25:06.538049 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1384722553 Oct 26 11:25:06.538049 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Id: 9d9d2ce62fb74bdb8de53bc06b1a999d Oct 26 11:25:06.538049 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1384722553 Oct 26 11:25:06.538049 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User: tempest-ServerRescueNegativeTestJSON-1384722553-project Oct 26 11:25:06.538049 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Id: default Oct 26 11:25:06.538049 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Name: Default Oct 26 11:25:06.538049 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Id: ff0c5f8521534fc1a0a9c5ea28fbaac1 Oct 26 11:25:06.538049 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1384722553-project Oct 26 11:25:06.538049 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: method: > Oct 26 11:25:06.538049 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: exception: Instance f2f70dba-88ab-42ae-ace7-b95eeac5fcfc could not be found. Oct 26 11:25:06.538049 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: action_args: {'id': 'f2f70dba-88ab-42ae-ace7-b95eeac5fcfc'} Oct 26 11:25:06.538812 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:25:06.538812 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:25:06.538812 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:25:06.538812 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:25:06.538812 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:25:06.538812 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:25:06.538812 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:25:06.538812 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:25:06.538812 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:25:06.538812 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:25:06.538812 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2f70dba-88ab-42ae-ace7-b95eeac5fcfc could not be found. Oct 26 11:25:06.538812 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:25:06.538812 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:25:06.538812 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:25:06.538812 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:25:06.538812 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:25:06.538812 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:25:06.538812 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:25:06.538812 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:25:06.538812 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:25:06.540229 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:25:06.540229 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 11:25:06.540229 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 11:25:06.540229 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:25:06.540229 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:25:06.540229 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:25:06.540229 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:25:06.540229 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2f70dba-88ab-42ae-ace7-b95eeac5fcfc could not be found. Oct 26 11:25:06.540229 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:25:06.540229 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:25:06.540229 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:25:06.540229 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:25:06.540229 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:25:06.540229 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:25:06.540229 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:25:06.540229 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:25:06.540229 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2f70dba-88ab-42ae-ace7-b95eeac5fcfc could not be found. Oct 26 11:25:06.540229 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:25:06.542395 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-3cb9d186-7a1d-493a-a2fd-60b107c2babb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] Returning 404 to user: Instance f2f70dba-88ab-42ae-ace7-b95eeac5fcfc could not be found. {{(pid=119306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:25:06.542395 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-3cb9d186-7a1d-493a-a2fd-60b107c2babb tempest-ServerRescueNegativeTestJSON-1384722553 tempest-ServerRescueNegativeTestJSON-1384722553-project] 10.222.0.42 "GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc" status: 404 len: 111 microversion: 2.1 time: 0.034097 Oct 26 11:25:06.542395 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 387/761] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:25:06 2022] GET /compute/v2.1/servers/f2f70dba-88ab-42ae-ace7-b95eeac5fcfc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:25:12.034395 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-b9953747-19b0-4537-9714-a0a225ec2851 tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] Action: 'create', calling method: .version_select at 0x7f6b93689790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1889921878"}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:25:12.574840 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-b9953747-19b0-4537-9714-a0a225ec2851 tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.651743 Oct 26 11:25:12.575479 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 375/762] 10.222.0.42 () {60 vars in 1155 bytes} [Wed Oct 26 11:25:11 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 653 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 26 11:25:12.589257 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-060c11ec-4a3d-40a8-a1de-547ae5cb127e tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] Calling method '.version_select at 0x7f6b9380e700>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:25:12.644239 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-060c11ec-4a3d-40a8-a1de-547ae5cb127e tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7" status: 200 len: 345 microversion: 2.1 time: 0.055773 Oct 26 11:25:12.644239 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 388/763] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Oct 26 11:25:12 2022] GET /compute/v2.1/os-volumes/7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:25:13.656668 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-dec663e8-f421-4029-802f-41def3345865 tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] Calling method '.version_select at 0x7f6b93705c10>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:25:13.705203 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-dec663e8-f421-4029-802f-41def3345865 tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7" status: 200 len: 346 microversion: 2.1 time: 0.052402 Oct 26 11:25:13.705808 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 376/764] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Oct 26 11:25:13 2022] GET /compute/v2.1/os-volumes/7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:25:13.719973 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-19bab404-77d5-4bf5-9319-0999bfa945d8 tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] Action: 'create', calling method: .version_select at 0x7f6b93635a60>, body: {"snapshot": {"volume_id": "7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1878170666"}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:25:14.121590 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-19bab404-77d5-4bf5-9319-0999bfa945d8 tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.405934 Oct 26 11:25:14.122322 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 389/765] 10.222.0.42 () {60 vars in 1162 bytes} [Wed Oct 26 11:25:13 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:25:14.133922 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-63f31f3c-5f29-4307-a9ad-a752b1b09813 tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] Calling method '.version_select at 0x7f6b937d8940>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:25:14.164678 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-63f31f3c-5f29-4307-a9ad-a752b1b09813 tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/d088e95d-d47a-43cb-8bd6-b5470a28db6e" status: 200 len: 287 microversion: 2.1 time: 0.034716 Oct 26 11:25:14.165326 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 377/766] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Oct 26 11:25:14 2022] GET /compute/v2.1/os-snapshots/d088e95d-d47a-43cb-8bd6-b5470a28db6e => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:25:14.176751 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-bad6c801-fa57-472d-9ec5-7d0ab46de7a7 tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] Calling method '.version_select at 0x7f6b93691c10>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:25:14.208848 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-bad6c801-fa57-472d-9ec5-7d0ab46de7a7 tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035822 Oct 26 11:25:14.208951 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 390/767] 10.222.0.42 () {58 vars in 1140 bytes} [Wed Oct 26 11:25:14 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:25:14.220174 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-f9f527fa-65ab-4362-b54c-896f732d9eb9 tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] Calling method '.version_select at 0x7f6b93689280>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:25:14.249110 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-f9f527fa-65ab-4362-b54c-896f732d9eb9 tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/d088e95d-d47a-43cb-8bd6-b5470a28db6e" status: 200 len: 287 microversion: 2.1 time: 0.032764 Oct 26 11:25:14.249668 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 378/768] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Oct 26 11:25:14 2022] GET /compute/v2.1/os-snapshots/d088e95d-d47a-43cb-8bd6-b5470a28db6e => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:25:15.262275 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-525209a3-50d7-4aa8-aa59-d98d7cac9d77 tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] Calling method '.version_select at 0x7f6b937a65e0>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:25:15.292356 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-525209a3-50d7-4aa8-aa59-d98d7cac9d77 tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/d088e95d-d47a-43cb-8bd6-b5470a28db6e" status: 200 len: 287 microversion: 2.1 time: 0.034334 Oct 26 11:25:15.292905 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 391/769] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Oct 26 11:25:15 2022] GET /compute/v2.1/os-snapshots/d088e95d-d47a-43cb-8bd6-b5470a28db6e => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:25:16.302383 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_api:SELECT=64 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:25:16.303155 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=97 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:25:16.306987 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-25222ccb-e697-48fc-a6d4-cb7d99bd01f3 tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] Calling method '.version_select at 0x7f6b97065670>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:25:16.337757 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-25222ccb-e697-48fc-a6d4-cb7d99bd01f3 tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/d088e95d-d47a-43cb-8bd6-b5470a28db6e" status: 200 len: 287 microversion: 2.1 time: 0.036622 Oct 26 11:25:16.338319 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 379/770] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Oct 26 11:25:16 2022] GET /compute/v2.1/os-snapshots/d088e95d-d47a-43cb-8bd6-b5470a28db6e => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:25:17.347041 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:25:17.351045 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-4134df4d-0924-47b0-970e-079493d1c32e tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] Calling method '.version_select at 0x7f6b937cadc0>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:25:17.381829 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-4134df4d-0924-47b0-970e-079493d1c32e tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/d088e95d-d47a-43cb-8bd6-b5470a28db6e" status: 200 len: 287 microversion: 2.1 time: 0.034317 Oct 26 11:25:17.381829 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 392/771] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Oct 26 11:25:17 2022] GET /compute/v2.1/os-snapshots/d088e95d-d47a-43cb-8bd6-b5470a28db6e => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:25:18.392784 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-dc204ba9-26b6-44d2-8623-8f888bb645ea tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] Calling method '.version_select at 0x7f6b93689e50>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:25:18.421886 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-dc204ba9-26b6-44d2-8623-8f888bb645ea tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/d088e95d-d47a-43cb-8bd6-b5470a28db6e" status: 200 len: 287 microversion: 2.1 time: 0.033502 Oct 26 11:25:18.422428 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 380/772] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Oct 26 11:25:18 2022] GET /compute/v2.1/os-snapshots/d088e95d-d47a-43cb-8bd6-b5470a28db6e => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:25:19.436342 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-33e71b2f-b003-43b1-86b0-3e5f7f8d54bb tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] Calling method '.version_select at 0x7f6b9367c1f0>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:25:19.467379 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-33e71b2f-b003-43b1-86b0-3e5f7f8d54bb tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/d088e95d-d47a-43cb-8bd6-b5470a28db6e" status: 200 len: 288 microversion: 2.1 time: 0.035592 Oct 26 11:25:19.467939 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 393/773] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Oct 26 11:25:19 2022] GET /compute/v2.1/os-snapshots/d088e95d-d47a-43cb-8bd6-b5470a28db6e => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:25:19.479459 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-0458f552-8991-41f5-a6aa-89b6b2eb9e08 tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] Calling method '.version_select at 0x7f6b93781430>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:25:19.594759 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-0458f552-8991-41f5-a6aa-89b6b2eb9e08 tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/d088e95d-d47a-43cb-8bd6-b5470a28db6e" status: 202 len: 0 microversion: 2.1 time: 0.119496 Oct 26 11:25:19.595362 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 381/774] 10.222.0.42 () {58 vars in 1254 bytes} [Wed Oct 26 11:25:19 2022] DELETE /compute/v2.1/os-snapshots/d088e95d-d47a-43cb-8bd6-b5470a28db6e => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 11:25:19.603683 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-cc382eba-1ca5-4d1c-987d-8bfb869c746c tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] Calling method '.version_select at 0x7f6b937caee0>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:25:19.633299 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-cc382eba-1ca5-4d1c-987d-8bfb869c746c tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/d088e95d-d47a-43cb-8bd6-b5470a28db6e" status: 200 len: 287 microversion: 2.1 time: 0.033685 Oct 26 11:25:19.634046 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 394/775] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Oct 26 11:25:19 2022] GET /compute/v2.1/os-snapshots/d088e95d-d47a-43cb-8bd6-b5470a28db6e => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:25:20.647038 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-2e7df6ee-470a-4847-9bc0-3857be71727d tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] Calling method '.version_select at 0x7f6b937574c0>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:25:20.672489 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.wsgi [None req-2e7df6ee-470a-4847-9bc0-3857be71727d tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] HTTP exception thrown: Snapshot d088e95d-d47a-43cb-8bd6-b5470a28db6e could not be found. Oct 26 11:25:20.675738 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-2e7df6ee-470a-4847-9bc0-3857be71727d tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] Request method failure captured: Oct 26 11:25:20.675738 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: request: GET /compute/v2.1/os-snapshots/d088e95d-d47a-43cb-8bd6-b5470a28db6e HTTP/1.1 Oct 26 11:25:20.675738 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept: application/json Oct 26 11:25:20.675738 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept-Encoding: identity Oct 26 11:25:20.675738 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Connection: close Oct 26 11:25:20.675738 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Length: 0 Oct 26 11:25:20.675738 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Type: application/json Oct 26 11:25:20.675738 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Host: 10.222.0.42 Oct 26 11:25:20.675738 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Openstack-System-Scope: None Oct 26 11:25:20.675738 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: User-Agent: python-urllib3/1.26.12 Oct 26 11:25:20.675738 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Auth-Token: gAAAAABjWRkXHEwIugOOh7Nf_sP7Zko8Msbp1NWXT5JTgAVlWr0ENWFGCvpKOu-dD74Y6nWTqsTYRtUw3TfNwn8T1xwxOfmhSJ5z9cacVZwKmWC4TA5rpM7avseZELpFrtWxHrBtYHc69MtkmB3p8kaZzvUYt0XRJhJmLsD2qu2fBt0gncTVOmo Oct 26 11:25:20.675738 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Id: None Oct 26 11:25:20.675738 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Name: None Oct 26 11:25:20.675738 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Identity-Status: Confirmed Oct 26 11:25:20.675738 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Is-Admin-Project: True Oct 26 11:25:20.675738 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Id: default Oct 26 11:25:20.675738 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Name: Default Oct 26 11:25:20.675738 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Id: 62356c04c66f40518aa06f5bb785a0a7 Oct 26 11:25:20.675738 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1175953182 Oct 26 11:25:20.675738 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Role: member,reader Oct 26 11:25:20.675738 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Roles: member,reader Oct 26 11:25:20.677350 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_62356c04c66f40518aa06f5bb785a0a7", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62356c04c66f40518aa06f5bb785a0a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/62356c04c66f40518aa06f5bb785a0a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62356c04c66f40518aa06f5bb785a0a7"}]}] Oct 26 11:25:20.677350 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1175953182 Oct 26 11:25:20.677350 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Id: 62356c04c66f40518aa06f5bb785a0a7 Oct 26 11:25:20.677350 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1175953182 Oct 26 11:25:20.677350 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User: tempest-VolumesSnapshotsTestJSON-1175953182-project Oct 26 11:25:20.677350 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Id: default Oct 26 11:25:20.677350 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Name: Default Oct 26 11:25:20.677350 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Id: bfe5a5d3119944d1be08966492d6174c Oct 26 11:25:20.677350 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1175953182-project Oct 26 11:25:20.677350 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: method: Oct 26 11:25:20.677350 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: exception: Snapshot d088e95d-d47a-43cb-8bd6-b5470a28db6e could not be found. Oct 26 11:25:20.677350 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: action_args: {'id': 'd088e95d-d47a-43cb-8bd6-b5470a28db6e'} Oct 26 11:25:20.677350 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:25:20.678427 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:25:20.678427 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 26 11:25:20.678427 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 26 11:25:20.678427 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 26 11:25:20.678427 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 26 11:25:20.678427 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 26 11:25:20.678427 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 26 11:25:20.678427 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 11:25:20.678427 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 11:25:20.678427 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 11:25:20.678427 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 11:25:20.678427 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 11:25:20.678427 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 11:25:20.678427 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 11:25:20.678427 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 11:25:20.678427 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d088e95d-d47a-43cb-8bd6-b5470a28db6e could not be found. (HTTP 404) (Request-ID: req-5ca17fb7-d154-425e-8356-bc81e58e7037) Oct 26 11:25:20.678427 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:25:20.678427 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:25:20.679984 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:25:20.679984 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:25:20.679984 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 26 11:25:20.679984 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 26 11:25:20.679984 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 26 11:25:20.679984 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 26 11:25:20.679984 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 26 11:25:20.679984 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 26 11:25:20.679984 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 26 11:25:20.679984 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 26 11:25:20.679984 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 26 11:25:20.679984 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 26 11:25:20.679984 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 26 11:25:20.679984 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 26 11:25:20.679984 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 26 11:25:20.679984 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 26 11:25:20.679984 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 11:25:20.679984 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 11:25:20.679984 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 11:25:20.681563 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 11:25:20.681563 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 11:25:20.681563 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 11:25:20.681563 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 11:25:20.681563 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 11:25:20.681563 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d088e95d-d47a-43cb-8bd6-b5470a28db6e could not be found. Oct 26 11:25:20.681563 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:25:20.681563 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:25:20.681563 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:25:20.681563 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:25:20.681563 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:25:20.681563 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:25:20.681563 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:25:20.681563 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:25:20.681563 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 11:25:20.681563 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 11:25:20.681563 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:25:20.681563 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:25:20.681563 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 26 11:25:20.681563 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:25:20.683202 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d088e95d-d47a-43cb-8bd6-b5470a28db6e could not be found. Oct 26 11:25:20.683202 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:25:20.683202 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:25:20.683202 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:25:20.683202 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:25:20.683202 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:25:20.683202 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:25:20.683202 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:25:20.683202 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:25:20.683202 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d088e95d-d47a-43cb-8bd6-b5470a28db6e could not be found. Oct 26 11:25:20.683202 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:25:20.683202 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-2e7df6ee-470a-4847-9bc0-3857be71727d tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] Returning 404 to user: Snapshot d088e95d-d47a-43cb-8bd6-b5470a28db6e could not be found. {{(pid=119305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:25:20.683202 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-2e7df6ee-470a-4847-9bc0-3857be71727d tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/d088e95d-d47a-43cb-8bd6-b5470a28db6e" status: 404 len: 111 microversion: 2.1 time: 0.034921 Oct 26 11:25:20.684347 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 382/776] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Oct 26 11:25:20 2022] GET /compute/v2.1/os-snapshots/d088e95d-d47a-43cb-8bd6-b5470a28db6e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:25:20.686582 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-26c1e27a-fc49-43da-97c8-d041f811c12d tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] Calling method '.version_select at 0x7f6b937a6310>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:25:20.861722 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-26c1e27a-fc49-43da-97c8-d041f811c12d tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7" status: 202 len: 0 microversion: 2.1 time: 0.179743 Oct 26 11:25:20.862290 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 395/777] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Oct 26 11:25:20 2022] DELETE /compute/v2.1/os-volumes/7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 11:25:20.870437 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-192cb540-7815-4414-9898-270279db2a3a tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] Calling method '.version_select at 0x7f6b97065940>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:25:20.917550 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-192cb540-7815-4414-9898-270279db2a3a tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7" status: 200 len: 345 microversion: 2.1 time: 0.050910 Oct 26 11:25:20.918136 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 383/778] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Oct 26 11:25:20 2022] GET /compute/v2.1/os-volumes/7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:25:21.933366 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-77ba3d5a-b71c-4009-9ed9-a2094c22a2ae tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] Calling method '.version_select at 0x7f6b9491b1f0>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:25:21.961022 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.wsgi [None req-77ba3d5a-b71c-4009-9ed9-a2094c22a2ae tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] HTTP exception thrown: Volume 7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7 could not be found. Oct 26 11:25:21.963139 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-77ba3d5a-b71c-4009-9ed9-a2094c22a2ae tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] Request method failure captured: Oct 26 11:25:21.963139 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: request: GET /compute/v2.1/os-volumes/7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7 HTTP/1.1 Oct 26 11:25:21.963139 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept: application/json Oct 26 11:25:21.963139 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept-Encoding: identity Oct 26 11:25:21.963139 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Connection: close Oct 26 11:25:21.963139 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Length: 0 Oct 26 11:25:21.963139 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Type: application/json Oct 26 11:25:21.963139 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Host: 10.222.0.42 Oct 26 11:25:21.963139 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Openstack-System-Scope: None Oct 26 11:25:21.963139 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: User-Agent: python-urllib3/1.26.12 Oct 26 11:25:21.963139 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Auth-Token: gAAAAABjWRkXHEwIugOOh7Nf_sP7Zko8Msbp1NWXT5JTgAVlWr0ENWFGCvpKOu-dD74Y6nWTqsTYRtUw3TfNwn8T1xwxOfmhSJ5z9cacVZwKmWC4TA5rpM7avseZELpFrtWxHrBtYHc69MtkmB3p8kaZzvUYt0XRJhJmLsD2qu2fBt0gncTVOmo Oct 26 11:25:21.963139 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Id: None Oct 26 11:25:21.963139 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Name: None Oct 26 11:25:21.963139 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Identity-Status: Confirmed Oct 26 11:25:21.963139 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Is-Admin-Project: True Oct 26 11:25:21.963139 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Id: default Oct 26 11:25:21.963139 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Name: Default Oct 26 11:25:21.963139 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Id: 62356c04c66f40518aa06f5bb785a0a7 Oct 26 11:25:21.963139 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1175953182 Oct 26 11:25:21.963139 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Role: member,reader Oct 26 11:25:21.963139 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Roles: member,reader Oct 26 11:25:21.964756 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_62356c04c66f40518aa06f5bb785a0a7", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62356c04c66f40518aa06f5bb785a0a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/62356c04c66f40518aa06f5bb785a0a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62356c04c66f40518aa06f5bb785a0a7"}]}] Oct 26 11:25:21.964756 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1175953182 Oct 26 11:25:21.964756 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Id: 62356c04c66f40518aa06f5bb785a0a7 Oct 26 11:25:21.964756 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1175953182 Oct 26 11:25:21.964756 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User: tempest-VolumesSnapshotsTestJSON-1175953182-project Oct 26 11:25:21.964756 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Id: default Oct 26 11:25:21.964756 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Name: Default Oct 26 11:25:21.964756 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Id: bfe5a5d3119944d1be08966492d6174c Oct 26 11:25:21.964756 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1175953182-project Oct 26 11:25:21.964756 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: method: Oct 26 11:25:21.964756 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: exception: Volume 7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7 could not be found. Oct 26 11:25:21.964756 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: action_args: {'id': '7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7'} Oct 26 11:25:21.964756 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:25:21.965793 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:25:21.965793 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 11:25:21.965793 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 11:25:21.965793 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 26 11:25:21.965793 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 26 11:25:21.965793 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 26 11:25:21.965793 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 26 11:25:21.965793 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 11:25:21.965793 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 11:25:21.965793 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 11:25:21.965793 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 11:25:21.965793 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 11:25:21.965793 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 11:25:21.965793 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 11:25:21.965793 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 11:25:21.965793 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7 could not be found. (HTTP 404) (Request-ID: req-0da49221-8fb7-4ae1-96ca-47a8149fd8d3) Oct 26 11:25:21.965793 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:25:21.965793 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:25:21.965793 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:25:21.967194 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:25:21.967194 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 26 11:25:21.967194 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 26 11:25:21.967194 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 26 11:25:21.967194 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 26 11:25:21.967194 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 26 11:25:21.967194 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 26 11:25:21.967194 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 26 11:25:21.967194 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 26 11:25:21.967194 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 11:25:21.967194 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 11:25:21.967194 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 26 11:25:21.967194 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 26 11:25:21.967194 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 26 11:25:21.967194 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 26 11:25:21.967194 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 11:25:21.967194 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 11:25:21.967194 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 11:25:21.967194 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 11:25:21.968942 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 11:25:21.968942 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 11:25:21.968942 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 11:25:21.968942 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 11:25:21.968942 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7 could not be found. Oct 26 11:25:21.968942 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:25:21.968942 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:25:21.968942 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:25:21.968942 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:25:21.968942 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:25:21.968942 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:25:21.968942 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:25:21.968942 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:25:21.968942 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 11:25:21.968942 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 11:25:21.968942 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:25:21.968942 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:25:21.968942 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 26 11:25:21.968942 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:25:21.970331 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7 could not be found. Oct 26 11:25:21.970331 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:25:21.970331 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:25:21.970331 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:25:21.970331 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:25:21.970331 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:25:21.970331 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:25:21.970331 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:25:21.970331 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:25:21.970331 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7 could not be found. Oct 26 11:25:21.970331 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:25:21.970331 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-77ba3d5a-b71c-4009-9ed9-a2094c22a2ae tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] Returning 404 to user: Volume 7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7 could not be found. {{(pid=119306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:25:21.970331 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-77ba3d5a-b71c-4009-9ed9-a2094c22a2ae tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7" status: 404 len: 109 microversion: 2.1 time: 0.035559 Oct 26 11:25:21.970331 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 396/779] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Oct 26 11:25:21 2022] GET /compute/v2.1/os-volumes/7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:25:21.979348 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-94af4d01-baa8-4066-854e-ccddf23e94a9 tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] Calling method '.version_select at 0x7f6b970721f0>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:25:22.010851 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.wsgi [None req-94af4d01-baa8-4066-854e-ccddf23e94a9 tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] HTTP exception thrown: Volume 7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7 could not be found. Oct 26 11:25:22.010851 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-94af4d01-baa8-4066-854e-ccddf23e94a9 tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] Request method failure captured: Oct 26 11:25:22.010851 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: request: DELETE /compute/v2.1/os-volumes/7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7 HTTP/1.1 Oct 26 11:25:22.010851 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept: application/json Oct 26 11:25:22.010851 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept-Encoding: identity Oct 26 11:25:22.010851 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Connection: close Oct 26 11:25:22.010851 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Length: 0 Oct 26 11:25:22.010851 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Type: application/json Oct 26 11:25:22.010851 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Host: 10.222.0.42 Oct 26 11:25:22.010851 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Openstack-System-Scope: None Oct 26 11:25:22.010851 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: User-Agent: python-urllib3/1.26.12 Oct 26 11:25:22.010851 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Auth-Token: gAAAAABjWRkXHEwIugOOh7Nf_sP7Zko8Msbp1NWXT5JTgAVlWr0ENWFGCvpKOu-dD74Y6nWTqsTYRtUw3TfNwn8T1xwxOfmhSJ5z9cacVZwKmWC4TA5rpM7avseZELpFrtWxHrBtYHc69MtkmB3p8kaZzvUYt0XRJhJmLsD2qu2fBt0gncTVOmo Oct 26 11:25:22.010851 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Id: None Oct 26 11:25:22.010851 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Name: None Oct 26 11:25:22.010851 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Identity-Status: Confirmed Oct 26 11:25:22.010851 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Is-Admin-Project: True Oct 26 11:25:22.010851 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Id: default Oct 26 11:25:22.010851 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Name: Default Oct 26 11:25:22.010851 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Id: 62356c04c66f40518aa06f5bb785a0a7 Oct 26 11:25:22.010851 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1175953182 Oct 26 11:25:22.010851 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Role: member,reader Oct 26 11:25:22.010851 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Roles: member,reader Oct 26 11:25:22.012434 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_62356c04c66f40518aa06f5bb785a0a7", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62356c04c66f40518aa06f5bb785a0a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/62356c04c66f40518aa06f5bb785a0a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62356c04c66f40518aa06f5bb785a0a7"}]}] Oct 26 11:25:22.012434 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1175953182 Oct 26 11:25:22.012434 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Id: 62356c04c66f40518aa06f5bb785a0a7 Oct 26 11:25:22.012434 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1175953182 Oct 26 11:25:22.012434 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User: tempest-VolumesSnapshotsTestJSON-1175953182-project Oct 26 11:25:22.012434 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Id: default Oct 26 11:25:22.012434 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Name: Default Oct 26 11:25:22.012434 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Id: bfe5a5d3119944d1be08966492d6174c Oct 26 11:25:22.012434 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1175953182-project Oct 26 11:25:22.012434 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: method: Oct 26 11:25:22.012434 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: exception: Volume 7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7 could not be found. Oct 26 11:25:22.012434 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: action_args: {'id': '7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7'} Oct 26 11:25:22.012434 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:25:22.013384 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:25:22.013384 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 11:25:22.013384 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 11:25:22.013384 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 26 11:25:22.013384 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 26 11:25:22.013384 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 26 11:25:22.013384 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 26 11:25:22.013384 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 26 11:25:22.013384 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 26 11:25:22.013384 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 26 11:25:22.013384 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 26 11:25:22.013384 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 11:25:22.013384 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 11:25:22.013384 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 11:25:22.013384 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 11:25:22.013384 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7 could not be found. (HTTP 404) (Request-ID: req-6e5d6889-597a-4e48-8cf4-07f156ac696c) Oct 26 11:25:22.013384 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:25:22.013384 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:25:22.013384 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:25:22.014703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:25:22.014703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 26 11:25:22.014703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 26 11:25:22.014703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 26 11:25:22.014703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 26 11:25:22.014703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 26 11:25:22.014703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 26 11:25:22.014703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 26 11:25:22.014703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 26 11:25:22.014703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 11:25:22.014703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 11:25:22.014703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 26 11:25:22.014703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 26 11:25:22.014703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 26 11:25:22.014703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 26 11:25:22.014703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 26 11:25:22.014703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 26 11:25:22.014703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 26 11:25:22.014703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 26 11:25:22.015848 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 11:25:22.015848 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 11:25:22.015848 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 11:25:22.015848 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 11:25:22.015848 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7 could not be found. Oct 26 11:25:22.015848 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:25:22.015848 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:25:22.015848 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:25:22.015848 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:25:22.015848 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:25:22.015848 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:25:22.015848 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:25:22.015848 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:25:22.015848 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 11:25:22.015848 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 11:25:22.015848 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:25:22.015848 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:25:22.015848 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 26 11:25:22.015848 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:25:22.016960 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7 could not be found. Oct 26 11:25:22.016960 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:25:22.016960 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:25:22.016960 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:25:22.016960 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:25:22.016960 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:25:22.016960 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:25:22.016960 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:25:22.016960 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:25:22.016960 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7 could not be found. Oct 26 11:25:22.016960 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:25:22.016960 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-94af4d01-baa8-4066-854e-ccddf23e94a9 tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] Returning 404 to user: Volume 7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7 could not be found. {{(pid=119305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:25:22.016960 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-94af4d01-baa8-4066-854e-ccddf23e94a9 tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7" status: 404 len: 109 microversion: 2.1 time: 0.035818 Oct 26 11:25:22.016960 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 384/780] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Oct 26 11:25:21 2022] DELETE /compute/v2.1/os-volumes/7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:25:22.019819 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e6eab27c-7533-430b-8437-bfa9bd11536d tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] Calling method '.version_select at 0x7f6b93635af0>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:25:22.047344 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.wsgi [None req-e6eab27c-7533-430b-8437-bfa9bd11536d tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] HTTP exception thrown: Volume 7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7 could not be found. Oct 26 11:25:22.049724 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e6eab27c-7533-430b-8437-bfa9bd11536d tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] Request method failure captured: Oct 26 11:25:22.049724 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: request: GET /compute/v2.1/os-volumes/7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7 HTTP/1.1 Oct 26 11:25:22.049724 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept: application/json Oct 26 11:25:22.049724 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept-Encoding: identity Oct 26 11:25:22.049724 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Connection: close Oct 26 11:25:22.049724 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Length: 0 Oct 26 11:25:22.049724 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Type: application/json Oct 26 11:25:22.049724 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Host: 10.222.0.42 Oct 26 11:25:22.049724 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Openstack-System-Scope: None Oct 26 11:25:22.049724 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: User-Agent: python-urllib3/1.26.12 Oct 26 11:25:22.049724 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Auth-Token: gAAAAABjWRkXHEwIugOOh7Nf_sP7Zko8Msbp1NWXT5JTgAVlWr0ENWFGCvpKOu-dD74Y6nWTqsTYRtUw3TfNwn8T1xwxOfmhSJ5z9cacVZwKmWC4TA5rpM7avseZELpFrtWxHrBtYHc69MtkmB3p8kaZzvUYt0XRJhJmLsD2qu2fBt0gncTVOmo Oct 26 11:25:22.049724 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Id: None Oct 26 11:25:22.049724 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Name: None Oct 26 11:25:22.049724 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Identity-Status: Confirmed Oct 26 11:25:22.049724 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Is-Admin-Project: True Oct 26 11:25:22.049724 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Id: default Oct 26 11:25:22.049724 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Name: Default Oct 26 11:25:22.049724 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Id: 62356c04c66f40518aa06f5bb785a0a7 Oct 26 11:25:22.049724 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1175953182 Oct 26 11:25:22.049724 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Role: member,reader Oct 26 11:25:22.049724 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Roles: member,reader Oct 26 11:25:22.051396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_62356c04c66f40518aa06f5bb785a0a7", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62356c04c66f40518aa06f5bb785a0a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/62356c04c66f40518aa06f5bb785a0a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/62356c04c66f40518aa06f5bb785a0a7"}]}] Oct 26 11:25:22.051396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1175953182 Oct 26 11:25:22.051396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Id: 62356c04c66f40518aa06f5bb785a0a7 Oct 26 11:25:22.051396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1175953182 Oct 26 11:25:22.051396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User: tempest-VolumesSnapshotsTestJSON-1175953182-project Oct 26 11:25:22.051396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Id: default Oct 26 11:25:22.051396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Name: Default Oct 26 11:25:22.051396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Id: bfe5a5d3119944d1be08966492d6174c Oct 26 11:25:22.051396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1175953182-project Oct 26 11:25:22.051396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: method: Oct 26 11:25:22.051396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: exception: Volume 7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7 could not be found. Oct 26 11:25:22.051396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: action_args: {'id': '7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7'} Oct 26 11:25:22.051396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:25:22.054185 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:25:22.054185 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 11:25:22.054185 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 11:25:22.054185 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 26 11:25:22.054185 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 26 11:25:22.054185 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 26 11:25:22.054185 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 26 11:25:22.054185 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 11:25:22.054185 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 11:25:22.054185 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 11:25:22.054185 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 11:25:22.054185 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 11:25:22.054185 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 11:25:22.054185 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 11:25:22.054185 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 11:25:22.054185 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7 could not be found. (HTTP 404) (Request-ID: req-14364ac8-292c-4be4-bd81-b8b21af90ba6) Oct 26 11:25:22.054185 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:25:22.054185 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:25:22.054185 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:25:22.055622 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:25:22.055622 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 26 11:25:22.055622 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 26 11:25:22.055622 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 26 11:25:22.055622 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 26 11:25:22.055622 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 26 11:25:22.055622 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 26 11:25:22.055622 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 26 11:25:22.055622 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 26 11:25:22.055622 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 11:25:22.055622 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 11:25:22.055622 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 26 11:25:22.055622 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 26 11:25:22.055622 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 26 11:25:22.055622 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 26 11:25:22.055622 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 11:25:22.055622 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 11:25:22.055622 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 11:25:22.055622 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 11:25:22.056927 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 11:25:22.056927 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 11:25:22.056927 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 11:25:22.056927 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 11:25:22.056927 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7 could not be found. Oct 26 11:25:22.056927 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:25:22.056927 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:25:22.056927 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:25:22.056927 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:25:22.056927 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:25:22.056927 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:25:22.056927 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:25:22.056927 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:25:22.056927 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 11:25:22.056927 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 11:25:22.056927 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:25:22.056927 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:25:22.056927 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 26 11:25:22.056927 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:25:22.058688 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7 could not be found. Oct 26 11:25:22.058688 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:25:22.058688 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:25:22.058688 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:25:22.058688 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:25:22.058688 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:25:22.058688 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:25:22.058688 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:25:22.058688 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:25:22.058688 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7 could not be found. Oct 26 11:25:22.058688 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:25:22.058688 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e6eab27c-7533-430b-8437-bfa9bd11536d tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] Returning 404 to user: Volume 7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7 could not be found. {{(pid=119306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:25:22.058688 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-e6eab27c-7533-430b-8437-bfa9bd11536d tempest-VolumesSnapshotsTestJSON-1175953182 tempest-VolumesSnapshotsTestJSON-1175953182-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7" status: 404 len: 109 microversion: 2.1 time: 0.035642 Oct 26 11:25:22.058688 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 397/781] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Oct 26 11:25:22 2022] GET /compute/v2.1/os-volumes/7f619e0f-e686-4d5d-8ec8-a80d42f4d2d7 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:25:48.616556 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-71ca566d-0923-430f-a519-df0a2005d6e3 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:25:48.617129 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-71ca566d-0923-430f-a519-df0a2005d6e3 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:25:48.622958 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-71ca566d-0923-430f-a519-df0a2005d6e3 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:25:48.623441 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-71ca566d-0923-430f-a519-df0a2005d6e3 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:25:48.623870 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-71ca566d-0923-430f-a519-df0a2005d6e3 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:25:48.624544 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-71ca566d-0923-430f-a519-df0a2005d6e3 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:25:48.624989 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-71ca566d-0923-430f-a519-df0a2005d6e3 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:25:48.625407 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-71ca566d-0923-430f-a519-df0a2005d6e3 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:25:48.648331 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-71ca566d-0923-430f-a519-df0a2005d6e3 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89/ips" status: 200 len: 150 microversion: 2.1 time: 0.036458 Oct 26 11:25:48.649373 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 385/782] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Oct 26 11:25:48 2022] GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:25:51.324199 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=1 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:25:51.328691 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-4e718efe-7c3e-4482-8b6c-d335d36098ff tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbbe97ff-91b2-4d8e-9939-ca1970d8656e"}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:25:51.331005 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-4e718efe-7c3e-4482-8b6c-d335d36098ff tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:25:51.336888 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4e718efe-7c3e-4482-8b6c-d335d36098ff tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:25:51.337372 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4e718efe-7c3e-4482-8b6c-d335d36098ff tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:25:51.337811 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4e718efe-7c3e-4482-8b6c-d335d36098ff tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:25:51.338517 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4e718efe-7c3e-4482-8b6c-d335d36098ff tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:25:51.339559 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4e718efe-7c3e-4482-8b6c-d335d36098ff tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:25:51.339968 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4e718efe-7c3e-4482-8b6c-d335d36098ff tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:25:52.043937 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-4e718efe-7c3e-4482-8b6c-d335d36098ff tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "POST /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.721465 Oct 26 11:25:52.044545 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 398/783] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Oct 26 11:25:51 2022] POST /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89/os-volume_attachments => generated 194 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:26:03.798277 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-6d449534-4d19-4fde-a2c0-1283723da527 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbbe97ff-91b2-4d8e-9939-ca1970d8656e"}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:26:03.800699 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-6d449534-4d19-4fde-a2c0-1283723da527 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:03.802717 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_api:SELECT=2 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:26:03.803741 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=4 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:26:03.808457 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6d449534-4d19-4fde-a2c0-1283723da527 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:03.823454 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6d449534-4d19-4fde-a2c0-1283723da527 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:03.823454 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6d449534-4d19-4fde-a2c0-1283723da527 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:03.823454 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6d449534-4d19-4fde-a2c0-1283723da527 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:03.823454 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6d449534-4d19-4fde-a2c0-1283723da527 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:03.823829 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6d449534-4d19-4fde-a2c0-1283723da527 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:03.890995 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.wsgi [None req-6d449534-4d19-4fde-a2c0-1283723da527 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] HTTP exception thrown: Invalid volume: volume cbbe97ff-91b2-4d8e-9939-ca1970d8656e is already attached to instances: be2a7ec3-e66b-477d-99da-8d730066cf89 Oct 26 11:26:03.892633 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-6d449534-4d19-4fde-a2c0-1283723da527 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Request method failure captured: Oct 26 11:26:03.892633 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: request: POST /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89/os-volume_attachments HTTP/1.1 Oct 26 11:26:03.892633 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept: application/json Oct 26 11:26:03.892633 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept-Encoding: identity Oct 26 11:26:03.892633 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Connection: close Oct 26 11:26:03.892633 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Length: 74 Oct 26 11:26:03.892633 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Type: application/json Oct 26 11:26:03.892633 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Host: 10.222.0.42 Oct 26 11:26:03.892633 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Openstack-System-Scope: None Oct 26 11:26:03.892633 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: User-Agent: python-urllib3/1.26.12 Oct 26 11:26:03.892633 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Auth-Token: gAAAAABjWRd0c_l4dNmZmsslzgq0Y1mw7cHb2LyArYA_xomuSGUALJJhwUTg-8wegSnjp12OMWl50wz-0CzDaxBHziSvRsAIfgm9nG8oyGTTyhi4gK_QpH-0WiSM5GZmswPu8j2lHFCwK-c7q-bBx1gr_dj9FZxEy_m8cDa2tIsj3jWPztpcm3k Oct 26 11:26:03.892633 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Id: None Oct 26 11:26:03.892633 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Name: None Oct 26 11:26:03.892633 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Identity-Status: Confirmed Oct 26 11:26:03.892633 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Is-Admin-Project: True Oct 26 11:26:03.892633 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Id: default Oct 26 11:26:03.892633 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Name: Default Oct 26 11:26:03.892633 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Id: 724121c2144843b7adc7e17312613c9d Oct 26 11:26:03.892633 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:26:03.892633 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Role: member,reader Oct 26 11:26:03.892633 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Roles: member,reader Oct 26 11:26:03.894261 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_724121c2144843b7adc7e17312613c9d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724121c2144843b7adc7e17312613c9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/724121c2144843b7adc7e17312613c9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724121c2144843b7adc7e17312613c9d"}]}] Oct 26 11:26:03.894261 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:26:03.894261 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Id: 724121c2144843b7adc7e17312613c9d Oct 26 11:26:03.894261 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:26:03.894261 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User: tempest-AttachVolumeNegativeTest-1560590927-project Oct 26 11:26:03.894261 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Id: default Oct 26 11:26:03.894261 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Name: Default Oct 26 11:26:03.894261 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Id: e031dd9da25146eebb8813dc8bad8b85 Oct 26 11:26:03.894261 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Name: tempest-AttachVolumeNegativeTest-1560590927-project Oct 26 11:26:03.894261 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Oct 26 11:26:03.894261 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {"volumeAttachment": {"volumeId": "cbbe97ff-91b2-4d8e-9939-ca1970d8656e"}} Oct 26 11:26:03.894261 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: method: > Oct 26 11:26:03.895234 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: exception: Invalid volume: volume cbbe97ff-91b2-4d8e-9939-ca1970d8656e is already attached to instances: be2a7ec3-e66b-477d-99da-8d730066cf89 Oct 26 11:26:03.895234 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: action_args: {'server_id': 'be2a7ec3-e66b-477d-99da-8d730066cf89', 'body': {'volumeAttachment': {'volumeId': 'cbbe97ff-91b2-4d8e-9939-ca1970d8656e'}}} Oct 26 11:26:03.895234 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:26:03.895234 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:26:03.895234 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 26 11:26:03.895234 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 26 11:26:03.895234 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 26 11:26:03.895234 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 26 11:26:03.895234 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 26 11:26:03.895234 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 26 11:26:03.895234 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 26 11:26:03.895234 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 26 11:26:03.895234 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 26 11:26:03.895234 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 26 11:26:03.895234 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cbbe97ff-91b2-4d8e-9939-ca1970d8656e is already attached to instances: be2a7ec3-e66b-477d-99da-8d730066cf89 Oct 26 11:26:03.895234 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:26:03.895234 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:26:03.895234 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:26:03.895234 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:26:03.897034 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:26:03.897034 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:26:03.897034 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:26:03.897034 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:26:03.897034 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:26:03.897034 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:26:03.897034 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 11:26:03.897034 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 11:26:03.897034 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 11:26:03.897034 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 11:26:03.897034 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 26 11:26:03.897034 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 26 11:26:03.897034 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 26 11:26:03.897034 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 26 11:26:03.897034 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cbbe97ff-91b2-4d8e-9939-ca1970d8656e is already attached to instances: be2a7ec3-e66b-477d-99da-8d730066cf89 Oct 26 11:26:03.897034 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:26:03.897034 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:26:03.897034 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:26:03.897034 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:26:03.897034 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:26:03.898592 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:26:03.898592 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:26:03.898592 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:26:03.898592 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cbbe97ff-91b2-4d8e-9939-ca1970d8656e is already attached to instances: be2a7ec3-e66b-477d-99da-8d730066cf89 Oct 26 11:26:03.898592 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:26:03.898592 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-6d449534-4d19-4fde-a2c0-1283723da527 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Returning 400 to user: Invalid volume: volume cbbe97ff-91b2-4d8e-9939-ca1970d8656e is already attached to instances: be2a7ec3-e66b-477d-99da-8d730066cf89 {{(pid=119305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:26:03.898592 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-6d449534-4d19-4fde-a2c0-1283723da527 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "POST /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100150 Oct 26 11:26:03.898592 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 386/784] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Oct 26 11:26:03 2022] POST /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 11:26:03.960206 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-42821677-1600-41eb-9d85-ff7d67a90055 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:03.960789 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-42821677-1600-41eb-9d85-ff7d67a90055 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:03.967212 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=2 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:26:03.967876 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:26:03.969948 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-42821677-1600-41eb-9d85-ff7d67a90055 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:03.970470 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-42821677-1600-41eb-9d85-ff7d67a90055 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:03.970939 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-42821677-1600-41eb-9d85-ff7d67a90055 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:03.972374 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-42821677-1600-41eb-9d85-ff7d67a90055 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:03.972374 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-42821677-1600-41eb-9d85-ff7d67a90055 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:03.972557 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-42821677-1600-41eb-9d85-ff7d67a90055 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:04.053323 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.objects.instance [None req-42821677-1600-41eb-9d85-ff7d67a90055 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lazy-loading 'services' on Instance uuid be2a7ec3-e66b-477d-99da-8d730066cf89 {{(pid=119306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:26:04.243778 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-42821677-1600-41eb-9d85-ff7d67a90055 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "DELETE /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89/os-volume_attachments/cbbe97ff-91b2-4d8e-9939-ca1970d8656e" status: 202 len: 0 microversion: 2.1 time: 0.287682 Oct 26 11:26:04.244379 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 399/785] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Oct 26 11:26:03 2022] DELETE /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89/os-volume_attachments/cbbe97ff-91b2-4d8e-9939-ca1970d8656e => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 11:26:04.253284 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-b36b416e-22ef-4ab4-82dd-940ec9b9e3f2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:04.255524 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-b36b416e-22ef-4ab4-82dd-940ec9b9e3f2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:04.262438 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b36b416e-22ef-4ab4-82dd-940ec9b9e3f2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:04.262868 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b36b416e-22ef-4ab4-82dd-940ec9b9e3f2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:04.267140 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b36b416e-22ef-4ab4-82dd-940ec9b9e3f2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:04.267140 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b36b416e-22ef-4ab4-82dd-940ec9b9e3f2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:04.267140 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b36b416e-22ef-4ab4-82dd-940ec9b9e3f2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:04.267140 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b36b416e-22ef-4ab4-82dd-940ec9b9e3f2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:04.294358 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-b36b416e-22ef-4ab4-82dd-940ec9b9e3f2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044980 Oct 26 11:26:04.295011 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 387/786] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Oct 26 11:26:04 2022] GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:26:05.308333 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-07b0d128-2858-4c20-90a3-3d2d5a363173 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:05.310597 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-07b0d128-2858-4c20-90a3-3d2d5a363173 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:05.316971 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-07b0d128-2858-4c20-90a3-3d2d5a363173 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:05.317445 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-07b0d128-2858-4c20-90a3-3d2d5a363173 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:05.323405 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-07b0d128-2858-4c20-90a3-3d2d5a363173 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:05.323405 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-07b0d128-2858-4c20-90a3-3d2d5a363173 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:05.323405 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-07b0d128-2858-4c20-90a3-3d2d5a363173 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:05.323405 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-07b0d128-2858-4c20-90a3-3d2d5a363173 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:05.349929 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-07b0d128-2858-4c20-90a3-3d2d5a363173 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046623 Oct 26 11:26:05.350415 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 400/787] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Oct 26 11:26:05 2022] GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:26:06.362328 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-719a6b86-6078-4d76-b501-2e5d3c904396 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:06.364512 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-719a6b86-6078-4d76-b501-2e5d3c904396 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:06.370848 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-719a6b86-6078-4d76-b501-2e5d3c904396 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:06.371279 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-719a6b86-6078-4d76-b501-2e5d3c904396 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:06.371714 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-719a6b86-6078-4d76-b501-2e5d3c904396 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:06.372427 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-719a6b86-6078-4d76-b501-2e5d3c904396 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:06.372879 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-719a6b86-6078-4d76-b501-2e5d3c904396 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:06.373303 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-719a6b86-6078-4d76-b501-2e5d3c904396 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:06.403452 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-719a6b86-6078-4d76-b501-2e5d3c904396 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045338 Oct 26 11:26:06.403997 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 388/788] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Oct 26 11:26:06 2022] GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:26:07.415437 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-45ceaea9-51b0-4e99-870b-93a5ca865cb8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:07.418195 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-45ceaea9-51b0-4e99-870b-93a5ca865cb8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:07.424504 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-45ceaea9-51b0-4e99-870b-93a5ca865cb8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:07.425002 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-45ceaea9-51b0-4e99-870b-93a5ca865cb8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:07.425419 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-45ceaea9-51b0-4e99-870b-93a5ca865cb8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:07.426097 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-45ceaea9-51b0-4e99-870b-93a5ca865cb8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:07.426542 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-45ceaea9-51b0-4e99-870b-93a5ca865cb8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:07.427002 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-45ceaea9-51b0-4e99-870b-93a5ca865cb8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:07.455698 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-45ceaea9-51b0-4e99-870b-93a5ca865cb8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044392 Oct 26 11:26:07.456245 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 401/789] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Oct 26 11:26:07 2022] GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:26:08.468383 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-3998613f-bf13-45de-93c7-79eff6ba42c9 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:08.470459 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-3998613f-bf13-45de-93c7-79eff6ba42c9 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:08.476790 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3998613f-bf13-45de-93c7-79eff6ba42c9 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:08.477270 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3998613f-bf13-45de-93c7-79eff6ba42c9 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:08.477706 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3998613f-bf13-45de-93c7-79eff6ba42c9 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:08.478423 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3998613f-bf13-45de-93c7-79eff6ba42c9 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:08.478904 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3998613f-bf13-45de-93c7-79eff6ba42c9 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:08.479821 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3998613f-bf13-45de-93c7-79eff6ba42c9 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:08.509117 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-3998613f-bf13-45de-93c7-79eff6ba42c9 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044944 Oct 26 11:26:08.509657 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 389/790] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Oct 26 11:26:08 2022] GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:26:09.521863 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-19b15941-39b6-41ca-9fe2-72f2131437c9 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:09.524086 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-19b15941-39b6-41ca-9fe2-72f2131437c9 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:09.530363 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-19b15941-39b6-41ca-9fe2-72f2131437c9 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:09.530874 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-19b15941-39b6-41ca-9fe2-72f2131437c9 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:09.531314 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-19b15941-39b6-41ca-9fe2-72f2131437c9 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:09.532002 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-19b15941-39b6-41ca-9fe2-72f2131437c9 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:09.532452 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-19b15941-39b6-41ca-9fe2-72f2131437c9 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:09.532873 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-19b15941-39b6-41ca-9fe2-72f2131437c9 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:09.563609 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-19b15941-39b6-41ca-9fe2-72f2131437c9 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046025 Oct 26 11:26:09.564178 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 402/791] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Oct 26 11:26:09 2022] GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 11:26:09.627899 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-f24031cb-28ff-44f2-966e-b4e97356d823 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:09.628403 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-f24031cb-28ff-44f2-966e-b4e97356d823 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:09.635226 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f24031cb-28ff-44f2-966e-b4e97356d823 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:09.636387 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f24031cb-28ff-44f2-966e-b4e97356d823 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:09.636832 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f24031cb-28ff-44f2-966e-b4e97356d823 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:09.637599 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f24031cb-28ff-44f2-966e-b4e97356d823 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:09.638059 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f24031cb-28ff-44f2-966e-b4e97356d823 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:09.638492 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f24031cb-28ff-44f2-966e-b4e97356d823 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:09.664219 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-f24031cb-28ff-44f2-966e-b4e97356d823 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Going to try to terminate instance {{(pid=119305) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 11:26:09.977300 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-f24031cb-28ff-44f2-966e-b4e97356d823 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "DELETE /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89" status: 204 len: 0 microversion: 2.1 time: 0.353026 Oct 26 11:26:09.977915 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 390/792] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Oct 26 11:26:09 2022] DELETE /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 11:26:09.986770 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-6044274b-4556-405d-b7d8-4e6526301a9c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:09.987410 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-6044274b-4556-405d-b7d8-4e6526301a9c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:09.993282 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6044274b-4556-405d-b7d8-4e6526301a9c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:09.993770 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6044274b-4556-405d-b7d8-4e6526301a9c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:09.994208 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6044274b-4556-405d-b7d8-4e6526301a9c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:09.995483 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6044274b-4556-405d-b7d8-4e6526301a9c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:09.995925 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6044274b-4556-405d-b7d8-4e6526301a9c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:09.996352 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6044274b-4556-405d-b7d8-4e6526301a9c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:10.125739 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-6044274b-4556-405d-b7d8-4e6526301a9c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:10.133422 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-6044274b-4556-405d-b7d8-4e6526301a9c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89" status: 200 len: 1682 microversion: 2.1 time: 0.150827 Oct 26 11:26:10.133998 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 403/793] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:09 2022] GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:11.157167 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-7e3f1237-c3fb-4acc-ae6b-1d9233fa8910 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:11.158064 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-7e3f1237-c3fb-4acc-ae6b-1d9233fa8910 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:11.164376 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7e3f1237-c3fb-4acc-ae6b-1d9233fa8910 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:11.164851 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7e3f1237-c3fb-4acc-ae6b-1d9233fa8910 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:11.165281 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7e3f1237-c3fb-4acc-ae6b-1d9233fa8910 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:11.165957 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7e3f1237-c3fb-4acc-ae6b-1d9233fa8910 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:11.166403 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7e3f1237-c3fb-4acc-ae6b-1d9233fa8910 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:11.166837 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7e3f1237-c3fb-4acc-ae6b-1d9233fa8910 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:11.297437 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-7e3f1237-c3fb-4acc-ae6b-1d9233fa8910 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:11.305057 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-7e3f1237-c3fb-4acc-ae6b-1d9233fa8910 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89" status: 200 len: 1682 microversion: 2.1 time: 0.152128 Oct 26 11:26:11.305616 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 391/794] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:11 2022] GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:12.328545 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-91a774ae-cbe9-4440-a254-9c2eba6359e6 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:12.329189 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-91a774ae-cbe9-4440-a254-9c2eba6359e6 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:12.335635 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-91a774ae-cbe9-4440-a254-9c2eba6359e6 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:12.336122 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-91a774ae-cbe9-4440-a254-9c2eba6359e6 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:12.336556 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-91a774ae-cbe9-4440-a254-9c2eba6359e6 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:12.337243 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-91a774ae-cbe9-4440-a254-9c2eba6359e6 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:12.337695 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-91a774ae-cbe9-4440-a254-9c2eba6359e6 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:12.338114 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-91a774ae-cbe9-4440-a254-9c2eba6359e6 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:12.463888 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-91a774ae-cbe9-4440-a254-9c2eba6359e6 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:12.471531 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-91a774ae-cbe9-4440-a254-9c2eba6359e6 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89" status: 200 len: 1682 microversion: 2.1 time: 0.146837 Oct 26 11:26:12.472102 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 404/795] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:12 2022] GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89 => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:13.494603 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-ffeef44a-6ef4-44ba-beea-b422f435f7c1 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:13.495172 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-ffeef44a-6ef4-44ba-beea-b422f435f7c1 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:13.501707 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ffeef44a-6ef4-44ba-beea-b422f435f7c1 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:13.502188 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ffeef44a-6ef4-44ba-beea-b422f435f7c1 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:13.502652 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ffeef44a-6ef4-44ba-beea-b422f435f7c1 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:13.503372 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ffeef44a-6ef4-44ba-beea-b422f435f7c1 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:13.503830 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ffeef44a-6ef4-44ba-beea-b422f435f7c1 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:13.504253 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ffeef44a-6ef4-44ba-beea-b422f435f7c1 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:13.628234 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-ffeef44a-6ef4-44ba-beea-b422f435f7c1 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:13.636302 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-ffeef44a-6ef4-44ba-beea-b422f435f7c1 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89" status: 200 len: 1682 microversion: 2.1 time: 0.145076 Oct 26 11:26:13.636872 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 392/796] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:13 2022] GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89 => generated 1682 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:14.659735 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-ca610ead-1339-4110-b7e8-42beba4bd94b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:14.660345 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-ca610ead-1339-4110-b7e8-42beba4bd94b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:14.667423 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ca610ead-1339-4110-b7e8-42beba4bd94b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:14.667905 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ca610ead-1339-4110-b7e8-42beba4bd94b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:14.668332 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ca610ead-1339-4110-b7e8-42beba4bd94b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:14.669012 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ca610ead-1339-4110-b7e8-42beba4bd94b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:14.669459 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ca610ead-1339-4110-b7e8-42beba4bd94b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:14.669876 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ca610ead-1339-4110-b7e8-42beba4bd94b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:14.796518 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ca610ead-1339-4110-b7e8-42beba4bd94b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:14.804170 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-ca610ead-1339-4110-b7e8-42beba4bd94b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89" status: 200 len: 1682 microversion: 2.1 time: 0.148279 Oct 26 11:26:14.804735 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 405/797] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:14 2022] GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:15.828880 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-89c38b8a-a3f7-4776-9586-7512801c6e85 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:15.829446 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-89c38b8a-a3f7-4776-9586-7512801c6e85 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:15.836326 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-89c38b8a-a3f7-4776-9586-7512801c6e85 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:15.836804 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-89c38b8a-a3f7-4776-9586-7512801c6e85 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:15.837231 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-89c38b8a-a3f7-4776-9586-7512801c6e85 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:15.837911 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-89c38b8a-a3f7-4776-9586-7512801c6e85 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:15.838405 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-89c38b8a-a3f7-4776-9586-7512801c6e85 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:15.839734 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-89c38b8a-a3f7-4776-9586-7512801c6e85 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:15.997243 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-89c38b8a-a3f7-4776-9586-7512801c6e85 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:16.004869 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-89c38b8a-a3f7-4776-9586-7512801c6e85 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89" status: 200 len: 1682 microversion: 2.1 time: 0.179825 Oct 26 11:26:16.005448 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 393/798] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:15 2022] GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89 => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:17.029343 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-8ec05616-6155-46ac-8efb-2914bd2e35cc tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:17.030063 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-8ec05616-6155-46ac-8efb-2914bd2e35cc tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:17.036614 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8ec05616-6155-46ac-8efb-2914bd2e35cc tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:17.037186 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8ec05616-6155-46ac-8efb-2914bd2e35cc tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:17.037708 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8ec05616-6155-46ac-8efb-2914bd2e35cc tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:17.038472 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8ec05616-6155-46ac-8efb-2914bd2e35cc tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:17.039027 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8ec05616-6155-46ac-8efb-2914bd2e35cc tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:17.039513 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8ec05616-6155-46ac-8efb-2914bd2e35cc tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:17.109260 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-8ec05616-6155-46ac-8efb-2914bd2e35cc tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:17.117798 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-8ec05616-6155-46ac-8efb-2914bd2e35cc tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89" status: 200 len: 1614 microversion: 2.1 time: 0.092904 Oct 26 11:26:17.118313 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 406/799] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:17 2022] GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89 => generated 1614 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:17.140315 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-f4e9b256-48c0-4bbc-91e5-8aee0f4767f9 req-957f63b5-212f-44e2-9a53-7602b064bb8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be2a7ec3-e66b-477d-99da-8d730066cf89", "name": "network-vif-deleted", "tag": "e22707f0-8877-4f00-ab3e-d053cdf8c8fa"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:26:17.150312 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-f4e9b256-48c0-4bbc-91e5-8aee0f4767f9 req-957f63b5-212f-44e2-9a53-7602b064bb8d service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:17.151516 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-f4e9b256-48c0-4bbc-91e5-8aee0f4767f9 req-957f63b5-212f-44e2-9a53-7602b064bb8d service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:17.151955 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-f4e9b256-48c0-4bbc-91e5-8aee0f4767f9 req-957f63b5-212f-44e2-9a53-7602b064bb8d service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:17.162860 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-f4e9b256-48c0-4bbc-91e5-8aee0f4767f9 req-957f63b5-212f-44e2-9a53-7602b064bb8d service nova] Creating event network-vif-deleted:e22707f0-8877-4f00-ab3e-d053cdf8c8fa for instance be2a7ec3-e66b-477d-99da-8d730066cf89 on hv-cinder-81558 Oct 26 11:26:17.168332 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-f4e9b256-48c0-4bbc-91e5-8aee0f4767f9 req-957f63b5-212f-44e2-9a53-7602b064bb8d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033539 Oct 26 11:26:17.169177 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 394/800] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:26:18.144649 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-2924eef4-0e85-4442-909f-33ffbbcaadeb tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:18.145530 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-2924eef4-0e85-4442-909f-33ffbbcaadeb tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:18.152233 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2924eef4-0e85-4442-909f-33ffbbcaadeb tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:18.152719 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2924eef4-0e85-4442-909f-33ffbbcaadeb tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:18.153209 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2924eef4-0e85-4442-909f-33ffbbcaadeb tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:18.153897 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2924eef4-0e85-4442-909f-33ffbbcaadeb tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:18.154391 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2924eef4-0e85-4442-909f-33ffbbcaadeb tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:18.154811 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2924eef4-0e85-4442-909f-33ffbbcaadeb tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:18.188242 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2924eef4-0e85-4442-909f-33ffbbcaadeb tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:18.188736 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2924eef4-0e85-4442-909f-33ffbbcaadeb tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:18.189177 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2924eef4-0e85-4442-909f-33ffbbcaadeb tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:18.189657 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.objects.instance [None req-2924eef4-0e85-4442-909f-33ffbbcaadeb tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lazy-loading 'fault' on Instance uuid be2a7ec3-e66b-477d-99da-8d730066cf89 {{(pid=119306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:26:18.232570 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-2924eef4-0e85-4442-909f-33ffbbcaadeb tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:18.240245 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-2924eef4-0e85-4442-909f-33ffbbcaadeb tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89" status: 200 len: 1331 microversion: 2.1 time: 0.100436 Oct 26 11:26:18.242291 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 407/801] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:18 2022] GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89 => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:19.265315 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-d9af4a48-d815-46fa-b07d-213b4dad98f8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:19.266007 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-d9af4a48-d815-46fa-b07d-213b4dad98f8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:19.272568 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d9af4a48-d815-46fa-b07d-213b4dad98f8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:19.273048 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d9af4a48-d815-46fa-b07d-213b4dad98f8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:19.273479 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d9af4a48-d815-46fa-b07d-213b4dad98f8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:19.274156 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d9af4a48-d815-46fa-b07d-213b4dad98f8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:19.274604 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d9af4a48-d815-46fa-b07d-213b4dad98f8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:19.275066 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d9af4a48-d815-46fa-b07d-213b4dad98f8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:19.289848 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.wsgi [None req-d9af4a48-d815-46fa-b07d-213b4dad98f8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] HTTP exception thrown: Instance be2a7ec3-e66b-477d-99da-8d730066cf89 could not be found. Oct 26 11:26:19.291432 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-d9af4a48-d815-46fa-b07d-213b4dad98f8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Request method failure captured: Oct 26 11:26:19.291432 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: request: GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89 HTTP/1.1 Oct 26 11:26:19.291432 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept: application/json Oct 26 11:26:19.291432 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept-Encoding: identity Oct 26 11:26:19.291432 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Connection: close Oct 26 11:26:19.291432 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Length: 0 Oct 26 11:26:19.291432 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Type: application/json Oct 26 11:26:19.291432 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Host: 10.222.0.42 Oct 26 11:26:19.291432 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Openstack-System-Scope: None Oct 26 11:26:19.291432 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: User-Agent: python-urllib3/1.26.12 Oct 26 11:26:19.291432 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Auth-Token: gAAAAABjWRd0c_l4dNmZmsslzgq0Y1mw7cHb2LyArYA_xomuSGUALJJhwUTg-8wegSnjp12OMWl50wz-0CzDaxBHziSvRsAIfgm9nG8oyGTTyhi4gK_QpH-0WiSM5GZmswPu8j2lHFCwK-c7q-bBx1gr_dj9FZxEy_m8cDa2tIsj3jWPztpcm3k Oct 26 11:26:19.291432 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Id: None Oct 26 11:26:19.291432 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Name: None Oct 26 11:26:19.291432 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Identity-Status: Confirmed Oct 26 11:26:19.291432 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Is-Admin-Project: True Oct 26 11:26:19.291432 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Id: default Oct 26 11:26:19.291432 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Name: Default Oct 26 11:26:19.291432 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Id: 724121c2144843b7adc7e17312613c9d Oct 26 11:26:19.291432 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:26:19.291432 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Role: member,reader Oct 26 11:26:19.291432 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Roles: member,reader Oct 26 11:26:19.293051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_724121c2144843b7adc7e17312613c9d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724121c2144843b7adc7e17312613c9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/724121c2144843b7adc7e17312613c9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724121c2144843b7adc7e17312613c9d"}]}] Oct 26 11:26:19.293051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:26:19.293051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Id: 724121c2144843b7adc7e17312613c9d Oct 26 11:26:19.293051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:26:19.293051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User: tempest-AttachVolumeNegativeTest-1560590927-project Oct 26 11:26:19.293051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Id: default Oct 26 11:26:19.293051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Name: Default Oct 26 11:26:19.293051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Id: e031dd9da25146eebb8813dc8bad8b85 Oct 26 11:26:19.293051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Name: tempest-AttachVolumeNegativeTest-1560590927-project Oct 26 11:26:19.293051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: method: > Oct 26 11:26:19.293051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: exception: Instance be2a7ec3-e66b-477d-99da-8d730066cf89 could not be found. Oct 26 11:26:19.293051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: action_args: {'id': 'be2a7ec3-e66b-477d-99da-8d730066cf89'} Oct 26 11:26:19.293883 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:26:19.293883 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:26:19.293883 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:26:19.293883 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:26:19.293883 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:26:19.293883 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:26:19.293883 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:26:19.293883 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:26:19.293883 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:26:19.293883 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:26:19.293883 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be2a7ec3-e66b-477d-99da-8d730066cf89 could not be found. Oct 26 11:26:19.293883 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:26:19.293883 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:26:19.293883 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:26:19.293883 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:26:19.293883 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:26:19.293883 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:26:19.293883 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:26:19.293883 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:26:19.293883 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:26:19.295190 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:26:19.295190 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 11:26:19.295190 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 11:26:19.295190 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:26:19.295190 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:26:19.295190 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:26:19.295190 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:26:19.295190 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be2a7ec3-e66b-477d-99da-8d730066cf89 could not be found. Oct 26 11:26:19.295190 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:26:19.295190 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:26:19.295190 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:26:19.295190 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:26:19.295190 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:26:19.295190 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:26:19.295190 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:26:19.295190 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:26:19.295190 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be2a7ec3-e66b-477d-99da-8d730066cf89 could not be found. Oct 26 11:26:19.295190 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:26:19.296354 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-d9af4a48-d815-46fa-b07d-213b4dad98f8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Returning 404 to user: Instance be2a7ec3-e66b-477d-99da-8d730066cf89 could not be found. {{(pid=119305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:26:19.296354 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-d9af4a48-d815-46fa-b07d-213b4dad98f8 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89" status: 404 len: 111 microversion: 2.1 time: 0.032736 Oct 26 11:26:19.296354 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 395/802] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:19 2022] GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:26:19.301536 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-fef1cd7d-b303-4ccf-b7ec-a9a6f950a67c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '.version_select at 0x7f6b93635d30>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:19.381465 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-fef1cd7d-b303-4ccf-b7ec-a9a6f950a67c tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-557646255" status: 202 len: 0 microversion: 2.1 time: 0.083708 Oct 26 11:26:19.382023 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 408/803] 10.222.0.42 () {58 vars in 1218 bytes} [Wed Oct 26 11:26:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-557646255 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 11:26:20.105533 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-017ad76e-6c04-4d23-bdbc-b763a89bfbc6 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Action: 'create', calling method: .version_select at 0x7f6b9705ec10>, body: {"keypair": {"name": "tempest-keypair-738686060", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL+aRFGcd0bcCNUPmfAW/eu39Mhnh215UXooiyhBxdhaa9LDYuKuofib8G+YmglrUpCcB/3SgaOFXXeKjKaVBuSJJ/LWEeotpYPgHWRUwczz2I/wtY4twf9X8Q4QMOGKw=="}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:26:20.120715 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.quota [None req-017ad76e-6c04-4d23-bdbc-b763a89bfbc6 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Getting quotas for project 724121c2144843b7adc7e17312613c9d. Resources: {'key_pairs'} {{(pid=119305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:26:20.124607 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.quota [None req-017ad76e-6c04-4d23-bdbc-b763a89bfbc6 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Getting quotas for user e031dd9da25146eebb8813dc8bad8b85 and project 724121c2144843b7adc7e17312613c9d. Resources: {'key_pairs'} {{(pid=119305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:26:20.205401 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-017ad76e-6c04-4d23-bdbc-b763a89bfbc6 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.104364 Oct 26 11:26:20.205981 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 396/804] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Oct 26 11:26:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:26:22.364541 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-b9134063-0520-443d-9082-7a0c79b7108a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-195789528", "imageRef": "ed8b5733-339c-4fa7-9767-abef514cb9f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b6fe9a7-2300-42a7-b12b-879816096b76"}], "security_groups": [{"name": "tempest-securitygroup--169087562"}], "key_name": "tempest-keypair-738686060", "user_data": "}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:26:22.465352 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.network.neutron [None req-b9134063-0520-443d-9082-7a0c79b7108a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] validate_networks() for [('4b6fe9a7-2300-42a7-b12b-879816096b76', None, None, None, None, None)] {{(pid=119306) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 11:26:22.832248 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-b9134063-0520-443d-9082-7a0c79b7108a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Flavor limits 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 11:26:22.833383 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-b9134063-0520-443d-9082-7a0c79b7108a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Image limits 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 11:26:22.833383 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-b9134063-0520-443d-9082-7a0c79b7108a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Flavor pref 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 11:26:22.833586 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-b9134063-0520-443d-9082-7a0c79b7108a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Image pref 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 11:26:22.833926 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-b9134063-0520-443d-9082-7a0c79b7108a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 11:26:22.843247 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b9134063-0520-443d-9082-7a0c79b7108a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:22.843723 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b9134063-0520-443d-9082-7a0c79b7108a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:22.844155 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b9134063-0520-443d-9082-7a0c79b7108a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:22.844909 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b9134063-0520-443d-9082-7a0c79b7108a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:22.845362 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b9134063-0520-443d-9082-7a0c79b7108a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:22.845786 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b9134063-0520-443d-9082-7a0c79b7108a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:22.863158 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-b9134063-0520-443d-9082-7a0c79b7108a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Getting quotas for project 724121c2144843b7adc7e17312613c9d. Resources: {'cores', 'instances', 'ram'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:26:22.866986 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-b9134063-0520-443d-9082-7a0c79b7108a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Getting quotas for user e031dd9da25146eebb8813dc8bad8b85 and project 724121c2144843b7adc7e17312613c9d. Resources: {'cores', 'instances', 'ram'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:26:22.877679 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-b9134063-0520-443d-9082-7a0c79b7108a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Going to run 1 instances... {{(pid=119306) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 11:26:22.880075 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-b9134063-0520-443d-9082-7a0c79b7108a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed8b5733-339c-4fa7-9767-abef514cb9f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119306) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 11:26:23.000960 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-b9134063-0520-443d-9082-7a0c79b7108a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.641195 Oct 26 11:26:23.001596 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 409/805] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Oct 26 11:26:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 11:26:23.013491 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-2a727fa8-0b94-4cb6-86a1-a1bf1436e5b2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:23.014177 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-2a727fa8-0b94-4cb6-86a1-a1bf1436e5b2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:23.068388 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-2a727fa8-0b94-4cb6-86a1-a1bf1436e5b2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:23.076876 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-2a727fa8-0b94-4cb6-86a1-a1bf1436e5b2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f" status: 200 len: 1240 microversion: 2.1 time: 0.067955 Oct 26 11:26:23.077772 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 397/806] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:23 2022] GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:24.101835 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-046f8dcc-964a-4286-a53f-5266bcb73a30 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:24.102363 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-046f8dcc-964a-4286-a53f-5266bcb73a30 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:24.108964 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-046f8dcc-964a-4286-a53f-5266bcb73a30 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:24.109436 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-046f8dcc-964a-4286-a53f-5266bcb73a30 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:24.109862 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-046f8dcc-964a-4286-a53f-5266bcb73a30 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:24.110542 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-046f8dcc-964a-4286-a53f-5266bcb73a30 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:24.111086 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-046f8dcc-964a-4286-a53f-5266bcb73a30 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:24.111503 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-046f8dcc-964a-4286-a53f-5266bcb73a30 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:24.179772 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-046f8dcc-964a-4286-a53f-5266bcb73a30 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:24.188359 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-046f8dcc-964a-4286-a53f-5266bcb73a30 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f" status: 200 len: 1244 microversion: 2.1 time: 0.091080 Oct 26 11:26:24.192709 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 410/807] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:24 2022] GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f => generated 1244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:25.211273 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-ca5ab823-230b-4e27-88f9-5403aff4d217 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:25.211954 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-ca5ab823-230b-4e27-88f9-5403aff4d217 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:25.218194 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ca5ab823-230b-4e27-88f9-5403aff4d217 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:25.218716 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ca5ab823-230b-4e27-88f9-5403aff4d217 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:25.224426 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ca5ab823-230b-4e27-88f9-5403aff4d217 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:25.224426 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ca5ab823-230b-4e27-88f9-5403aff4d217 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:25.224426 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ca5ab823-230b-4e27-88f9-5403aff4d217 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:25.224426 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ca5ab823-230b-4e27-88f9-5403aff4d217 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:25.313308 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-ca5ab823-230b-4e27-88f9-5403aff4d217 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:25.320949 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-ca5ab823-230b-4e27-88f9-5403aff4d217 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f" status: 200 len: 1300 microversion: 2.1 time: 0.113679 Oct 26 11:26:25.321568 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 398/808] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:25 2022] GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f => generated 1300 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:26.345066 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-c458a16a-4a70-4c1f-9042-99315c6c513d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:26.345766 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-c458a16a-4a70-4c1f-9042-99315c6c513d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:26.352065 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c458a16a-4a70-4c1f-9042-99315c6c513d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:26.352545 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c458a16a-4a70-4c1f-9042-99315c6c513d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:26.352972 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c458a16a-4a70-4c1f-9042-99315c6c513d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:26.353659 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c458a16a-4a70-4c1f-9042-99315c6c513d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:26.354106 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c458a16a-4a70-4c1f-9042-99315c6c513d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:26.354521 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c458a16a-4a70-4c1f-9042-99315c6c513d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:26.419050 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-c458a16a-4a70-4c1f-9042-99315c6c513d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:26.427710 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-c458a16a-4a70-4c1f-9042-99315c6c513d tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f" status: 200 len: 1298 microversion: 2.1 time: 0.087178 Oct 26 11:26:26.428297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 411/809] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:26 2022] GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f => generated 1298 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:26.479065 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-bbf6d5b5-c872-4884-be60-d5602cbd8e1b tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:26.479715 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-bbf6d5b5-c872-4884-be60-d5602cbd8e1b tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:26.487518 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bbf6d5b5-c872-4884-be60-d5602cbd8e1b tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:26.487846 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bbf6d5b5-c872-4884-be60-d5602cbd8e1b tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:26.488461 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bbf6d5b5-c872-4884-be60-d5602cbd8e1b tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:26.490105 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bbf6d5b5-c872-4884-be60-d5602cbd8e1b tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:26.491772 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bbf6d5b5-c872-4884-be60-d5602cbd8e1b tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:26.492358 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bbf6d5b5-c872-4884-be60-d5602cbd8e1b tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:26.494380 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-53aa6724-bf75-44d8-ad74-86e0cfe6c1bf req-c35db15b-14aa-4a34-8506-8dc0b7106bca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4b20a22-cb3b-4fb4-8b69-3b626cd6d991", "tag": "de570ff5-446d-40b7-add4-d927b658a166"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:26:26.518752 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-53aa6724-bf75-44d8-ad74-86e0cfe6c1bf req-c35db15b-14aa-4a34-8506-8dc0b7106bca service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:26.522803 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-53aa6724-bf75-44d8-ad74-86e0cfe6c1bf req-c35db15b-14aa-4a34-8506-8dc0b7106bca service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:26.522803 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-53aa6724-bf75-44d8-ad74-86e0cfe6c1bf req-c35db15b-14aa-4a34-8506-8dc0b7106bca service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:26.536021 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-bbf6d5b5-c872-4884-be60-d5602cbd8e1b tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Going to try to terminate instance {{(pid=119305) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 11:26:26.544487 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-53aa6724-bf75-44d8-ad74-86e0cfe6c1bf req-c35db15b-14aa-4a34-8506-8dc0b7106bca service nova] Creating event network-changed:de570ff5-446d-40b7-add4-d927b658a166 for instance e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 on hv-cinder-81558 Oct 26 11:26:26.553097 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-53aa6724-bf75-44d8-ad74-86e0cfe6c1bf req-c35db15b-14aa-4a34-8506-8dc0b7106bca service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067881 Oct 26 11:26:26.554088 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 412/810] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:26:26.838992 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-bbf6d5b5-c872-4884-be60-d5602cbd8e1b tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 204 len: 0 microversion: 2.1 time: 0.364283 Oct 26 11:26:26.839597 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 399/811] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Oct 26 11:26:26 2022] DELETE /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 11:26:26.848996 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-42da8bb1-cd03-4a05-a1ac-4bb435d67341 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:26.850016 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-42da8bb1-cd03-4a05-a1ac-4bb435d67341 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:26.857328 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-42da8bb1-cd03-4a05-a1ac-4bb435d67341 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:26.857821 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-42da8bb1-cd03-4a05-a1ac-4bb435d67341 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:26.858259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-42da8bb1-cd03-4a05-a1ac-4bb435d67341 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:26.859107 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-42da8bb1-cd03-4a05-a1ac-4bb435d67341 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:26.859600 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-42da8bb1-cd03-4a05-a1ac-4bb435d67341 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:26.860027 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-42da8bb1-cd03-4a05-a1ac-4bb435d67341 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:26.990792 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-42da8bb1-cd03-4a05-a1ac-4bb435d67341 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:26.998712 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-42da8bb1-cd03-4a05-a1ac-4bb435d67341 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1568 microversion: 2.1 time: 0.153999 Oct 26 11:26:26.999399 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 413/812] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:26 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:27.451869 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-28187edb-4148-4c93-a8cf-4e375114a4d7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:27.452579 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-28187edb-4148-4c93-a8cf-4e375114a4d7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:27.458523 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-28187edb-4148-4c93-a8cf-4e375114a4d7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:27.459185 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-28187edb-4148-4c93-a8cf-4e375114a4d7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:27.459638 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-28187edb-4148-4c93-a8cf-4e375114a4d7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:27.460333 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-28187edb-4148-4c93-a8cf-4e375114a4d7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:27.460789 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-28187edb-4148-4c93-a8cf-4e375114a4d7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:27.461217 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-28187edb-4148-4c93-a8cf-4e375114a4d7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:27.588330 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-28187edb-4148-4c93-a8cf-4e375114a4d7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:27.596540 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-28187edb-4148-4c93-a8cf-4e375114a4d7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f" status: 200 len: 1365 microversion: 2.1 time: 0.149273 Oct 26 11:26:27.597142 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 400/813] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:27 2022] GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:28.023050 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-b66d1848-2dbc-4cc8-8ac1-3a0a7c273294 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:28.023580 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-b66d1848-2dbc-4cc8-8ac1-3a0a7c273294 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:28.030447 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b66d1848-2dbc-4cc8-8ac1-3a0a7c273294 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:28.030947 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b66d1848-2dbc-4cc8-8ac1-3a0a7c273294 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:28.031379 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b66d1848-2dbc-4cc8-8ac1-3a0a7c273294 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:28.032221 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b66d1848-2dbc-4cc8-8ac1-3a0a7c273294 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:28.032673 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b66d1848-2dbc-4cc8-8ac1-3a0a7c273294 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:28.033092 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b66d1848-2dbc-4cc8-8ac1-3a0a7c273294 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:28.165386 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-b66d1848-2dbc-4cc8-8ac1-3a0a7c273294 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:28.173275 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-b66d1848-2dbc-4cc8-8ac1-3a0a7c273294 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1568 microversion: 2.1 time: 0.154433 Oct 26 11:26:28.174095 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 414/814] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:28 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:28.619956 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-c8f3a496-db9e-4ae5-984a-5c55398fe90a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:28.620607 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-c8f3a496-db9e-4ae5-984a-5c55398fe90a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:28.627607 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c8f3a496-db9e-4ae5-984a-5c55398fe90a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:28.628089 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c8f3a496-db9e-4ae5-984a-5c55398fe90a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:28.628528 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c8f3a496-db9e-4ae5-984a-5c55398fe90a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:28.629218 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c8f3a496-db9e-4ae5-984a-5c55398fe90a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:28.629673 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c8f3a496-db9e-4ae5-984a-5c55398fe90a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:28.630099 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c8f3a496-db9e-4ae5-984a-5c55398fe90a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:28.757263 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-c8f3a496-db9e-4ae5-984a-5c55398fe90a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:28.764953 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-c8f3a496-db9e-4ae5-984a-5c55398fe90a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f" status: 200 len: 1365 microversion: 2.1 time: 0.148822 Oct 26 11:26:28.765514 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 401/815] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:28 2022] GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:29.196511 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-cb0a5e56-9fff-4b21-aed4-fae2c668973a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:29.197261 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-cb0a5e56-9fff-4b21-aed4-fae2c668973a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:29.204373 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-cb0a5e56-9fff-4b21-aed4-fae2c668973a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:29.205906 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-cb0a5e56-9fff-4b21-aed4-fae2c668973a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:29.206349 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-cb0a5e56-9fff-4b21-aed4-fae2c668973a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:29.207197 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-cb0a5e56-9fff-4b21-aed4-fae2c668973a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:29.207657 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-cb0a5e56-9fff-4b21-aed4-fae2c668973a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:29.208080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-cb0a5e56-9fff-4b21-aed4-fae2c668973a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:29.336653 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-cb0a5e56-9fff-4b21-aed4-fae2c668973a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:29.345084 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-cb0a5e56-9fff-4b21-aed4-fae2c668973a tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1568 microversion: 2.1 time: 0.152484 Oct 26 11:26:29.345657 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 415/816] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:29 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:29.788425 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-503941d5-cb49-4541-aa56-8c1701ab6706 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:29.789145 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-503941d5-cb49-4541-aa56-8c1701ab6706 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:29.795874 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-503941d5-cb49-4541-aa56-8c1701ab6706 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:29.796360 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-503941d5-cb49-4541-aa56-8c1701ab6706 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:29.796797 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-503941d5-cb49-4541-aa56-8c1701ab6706 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:29.797495 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-503941d5-cb49-4541-aa56-8c1701ab6706 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:29.797972 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-503941d5-cb49-4541-aa56-8c1701ab6706 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:29.798503 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-503941d5-cb49-4541-aa56-8c1701ab6706 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:29.817718 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:26:29.976946 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-503941d5-cb49-4541-aa56-8c1701ab6706 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:29.984830 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-503941d5-cb49-4541-aa56-8c1701ab6706 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f" status: 200 len: 1365 microversion: 2.1 time: 0.200300 Oct 26 11:26:29.985392 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 402/817] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:29 2022] GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:30.049748 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-c0ee46db-a722-4cf9-82d7-0631377518bb req-86175cf3-5f8f-4a02-ab89-6171c4b50f3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7f58550-4456-4d0f-b050-e0be7959139f", "tag": "7b01f1f3-91ab-48bc-ba7f-676d9f2823c0"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:26:30.058894 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-c0ee46db-a722-4cf9-82d7-0631377518bb req-86175cf3-5f8f-4a02-ab89-6171c4b50f3c service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:30.059369 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-c0ee46db-a722-4cf9-82d7-0631377518bb req-86175cf3-5f8f-4a02-ab89-6171c4b50f3c service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:30.060379 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-c0ee46db-a722-4cf9-82d7-0631377518bb req-86175cf3-5f8f-4a02-ab89-6171c4b50f3c service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:30.071064 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-c0ee46db-a722-4cf9-82d7-0631377518bb req-86175cf3-5f8f-4a02-ab89-6171c4b50f3c service nova] Creating event network-changed:7b01f1f3-91ab-48bc-ba7f-676d9f2823c0 for instance d7f58550-4456-4d0f-b050-e0be7959139f on hv-cinder-81558 Oct 26 11:26:30.075813 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-c0ee46db-a722-4cf9-82d7-0631377518bb req-86175cf3-5f8f-4a02-ab89-6171c4b50f3c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029634 Oct 26 11:26:30.076681 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 416/818] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:26:30.368517 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-339975ca-6e6f-4833-a645-9a1cececcef4 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:30.369152 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-339975ca-6e6f-4833-a645-9a1cececcef4 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:30.375147 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-339975ca-6e6f-4833-a645-9a1cececcef4 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:30.375628 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-339975ca-6e6f-4833-a645-9a1cececcef4 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:30.376059 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-339975ca-6e6f-4833-a645-9a1cececcef4 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:30.376738 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-339975ca-6e6f-4833-a645-9a1cececcef4 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:30.377185 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-339975ca-6e6f-4833-a645-9a1cececcef4 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:30.377607 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-339975ca-6e6f-4833-a645-9a1cececcef4 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:30.504327 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-339975ca-6e6f-4833-a645-9a1cececcef4 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:30.512195 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-339975ca-6e6f-4833-a645-9a1cececcef4 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1568 microversion: 2.1 time: 0.147827 Oct 26 11:26:30.512767 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 403/819] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:30 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:31.008848 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-b7f11e26-19b7-4da7-80cf-82fe4d8828a0 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:31.009483 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-b7f11e26-19b7-4da7-80cf-82fe4d8828a0 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:31.016174 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b7f11e26-19b7-4da7-80cf-82fe4d8828a0 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:31.016658 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b7f11e26-19b7-4da7-80cf-82fe4d8828a0 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:31.017090 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b7f11e26-19b7-4da7-80cf-82fe4d8828a0 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:31.017774 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b7f11e26-19b7-4da7-80cf-82fe4d8828a0 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:31.018227 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b7f11e26-19b7-4da7-80cf-82fe4d8828a0 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:31.018648 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b7f11e26-19b7-4da7-80cf-82fe4d8828a0 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:31.039259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:26:31.147893 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-b7f11e26-19b7-4da7-80cf-82fe4d8828a0 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:31.155473 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-b7f11e26-19b7-4da7-80cf-82fe4d8828a0 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f" status: 200 len: 1365 microversion: 2.1 time: 0.151379 Oct 26 11:26:31.156048 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 417/820] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:31 2022] GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:31.535850 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-978f5544-7c2e-454d-8e80-740564df6298 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:31.536421 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-978f5544-7c2e-454d-8e80-740564df6298 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:31.545788 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-978f5544-7c2e-454d-8e80-740564df6298 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:31.546263 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-978f5544-7c2e-454d-8e80-740564df6298 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:31.546697 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-978f5544-7c2e-454d-8e80-740564df6298 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:31.547432 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-978f5544-7c2e-454d-8e80-740564df6298 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:31.547891 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-978f5544-7c2e-454d-8e80-740564df6298 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:31.548303 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-978f5544-7c2e-454d-8e80-740564df6298 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:31.680437 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-978f5544-7c2e-454d-8e80-740564df6298 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:31.689211 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-978f5544-7c2e-454d-8e80-740564df6298 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1568 microversion: 2.1 time: 0.157324 Oct 26 11:26:31.689968 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 404/821] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:31 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:32.177622 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-fa7ca98d-e5ff-4e3f-885a-8e9df7f817da tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:32.178158 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-fa7ca98d-e5ff-4e3f-885a-8e9df7f817da tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:32.184629 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fa7ca98d-e5ff-4e3f-885a-8e9df7f817da tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:32.185116 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fa7ca98d-e5ff-4e3f-885a-8e9df7f817da tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:32.185607 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fa7ca98d-e5ff-4e3f-885a-8e9df7f817da tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:32.186312 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fa7ca98d-e5ff-4e3f-885a-8e9df7f817da tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:32.186767 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fa7ca98d-e5ff-4e3f-885a-8e9df7f817da tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:32.187240 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fa7ca98d-e5ff-4e3f-885a-8e9df7f817da tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:32.382855 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-fa7ca98d-e5ff-4e3f-885a-8e9df7f817da tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:32.388308 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-fa7ca98d-e5ff-4e3f-885a-8e9df7f817da tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f" status: 200 len: 1365 microversion: 2.1 time: 0.214695 Oct 26 11:26:32.389372 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 418/822] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:32 2022] GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:32.713588 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-6d0170df-6f58-4b1d-b76d-abcafa7787c0 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:32.714755 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-6d0170df-6f58-4b1d-b76d-abcafa7787c0 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:32.721839 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6d0170df-6f58-4b1d-b76d-abcafa7787c0 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:32.722329 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6d0170df-6f58-4b1d-b76d-abcafa7787c0 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:32.722764 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6d0170df-6f58-4b1d-b76d-abcafa7787c0 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:32.723485 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6d0170df-6f58-4b1d-b76d-abcafa7787c0 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:32.723934 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6d0170df-6f58-4b1d-b76d-abcafa7787c0 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:32.724351 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6d0170df-6f58-4b1d-b76d-abcafa7787c0 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:32.858594 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-6d0170df-6f58-4b1d-b76d-abcafa7787c0 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:32.866240 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-6d0170df-6f58-4b1d-b76d-abcafa7787c0 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1568 microversion: 2.1 time: 0.157492 Oct 26 11:26:32.868372 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 405/823] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:32 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:33.422465 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-a2bea7e6-53e3-49fa-8171-0b79c87f1440 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:33.422465 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-a2bea7e6-53e3-49fa-8171-0b79c87f1440 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:33.422465 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell0:SELECT=2 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:26:33.422465 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell0:SELECT=6 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:26:33.422465 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a2bea7e6-53e3-49fa-8171-0b79c87f1440 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:33.423260 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a2bea7e6-53e3-49fa-8171-0b79c87f1440 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:33.423260 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a2bea7e6-53e3-49fa-8171-0b79c87f1440 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:33.423260 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a2bea7e6-53e3-49fa-8171-0b79c87f1440 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:33.423260 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a2bea7e6-53e3-49fa-8171-0b79c87f1440 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:33.423543 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a2bea7e6-53e3-49fa-8171-0b79c87f1440 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:33.448620 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-fd341b82-7628-4df3-b52e-b2b36ad21f9e req-c172aedd-3e48-42f4-bbb7-7e4289c5ae76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4b20a22-cb3b-4fb4-8b69-3b626cd6d991", "name": "network-vif-deleted", "tag": "de570ff5-446d-40b7-add4-d927b658a166"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:26:33.453721 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell0:SELECT=6 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:26:33.458984 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-fd341b82-7628-4df3-b52e-b2b36ad21f9e req-c172aedd-3e48-42f4-bbb7-7e4289c5ae76 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:33.459578 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-fd341b82-7628-4df3-b52e-b2b36ad21f9e req-c172aedd-3e48-42f4-bbb7-7e4289c5ae76 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:33.460120 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-fd341b82-7628-4df3-b52e-b2b36ad21f9e req-c172aedd-3e48-42f4-bbb7-7e4289c5ae76 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:33.472001 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-fd341b82-7628-4df3-b52e-b2b36ad21f9e req-c172aedd-3e48-42f4-bbb7-7e4289c5ae76 service nova] Creating event network-vif-deleted:de570ff5-446d-40b7-add4-d927b658a166 for instance e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 on hv-cinder-81558 Oct 26 11:26:33.477035 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-fd341b82-7628-4df3-b52e-b2b36ad21f9e req-c172aedd-3e48-42f4-bbb7-7e4289c5ae76 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031998 Oct 26 11:26:33.477629 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 406/824] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:26:33.556145 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-a2bea7e6-53e3-49fa-8171-0b79c87f1440 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:33.563903 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-a2bea7e6-53e3-49fa-8171-0b79c87f1440 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f" status: 200 len: 1365 microversion: 2.1 time: 0.155818 Oct 26 11:26:33.564469 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 419/825] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:33 2022] GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:33.894851 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-4ebfdb53-2f36-4957-9480-acc0f4d23243 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:33.895655 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-4ebfdb53-2f36-4957-9480-acc0f4d23243 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:33.898919 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:26:33.905179 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4ebfdb53-2f36-4957-9480-acc0f4d23243 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:33.905670 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4ebfdb53-2f36-4957-9480-acc0f4d23243 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:33.911700 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4ebfdb53-2f36-4957-9480-acc0f4d23243 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:33.911700 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4ebfdb53-2f36-4957-9480-acc0f4d23243 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:33.911700 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4ebfdb53-2f36-4957-9480-acc0f4d23243 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:33.911700 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4ebfdb53-2f36-4957-9480-acc0f4d23243 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:33.973684 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-4ebfdb53-2f36-4957-9480-acc0f4d23243 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:33.982654 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-4ebfdb53-2f36-4957-9480-acc0f4d23243 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1382 microversion: 2.1 time: 0.091952 Oct 26 11:26:33.983281 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 407/826] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:33 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1382 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:34.585923 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-d5ff6f74-75bf-4b4c-8707-1c346b234b8a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:34.586466 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-d5ff6f74-75bf-4b4c-8707-1c346b234b8a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:34.588813 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:26:34.593467 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d5ff6f74-75bf-4b4c-8707-1c346b234b8a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:34.593953 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d5ff6f74-75bf-4b4c-8707-1c346b234b8a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:34.594389 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d5ff6f74-75bf-4b4c-8707-1c346b234b8a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:34.599678 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d5ff6f74-75bf-4b4c-8707-1c346b234b8a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:34.599678 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d5ff6f74-75bf-4b4c-8707-1c346b234b8a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:34.599678 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d5ff6f74-75bf-4b4c-8707-1c346b234b8a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:34.722017 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-d5ff6f74-75bf-4b4c-8707-1c346b234b8a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:34.729877 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-d5ff6f74-75bf-4b4c-8707-1c346b234b8a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f" status: 200 len: 1365 microversion: 2.1 time: 0.147870 Oct 26 11:26:34.730439 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 420/827] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:34 2022] GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:35.009915 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-c962f442-2ed3-4d2a-b7b1-9e07d2c3ad18 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:35.010536 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-c962f442-2ed3-4d2a-b7b1-9e07d2c3ad18 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:35.017125 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c962f442-2ed3-4d2a-b7b1-9e07d2c3ad18 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:35.017613 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c962f442-2ed3-4d2a-b7b1-9e07d2c3ad18 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:35.018115 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c962f442-2ed3-4d2a-b7b1-9e07d2c3ad18 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:35.018811 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c962f442-2ed3-4d2a-b7b1-9e07d2c3ad18 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:35.019357 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c962f442-2ed3-4d2a-b7b1-9e07d2c3ad18 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:35.019783 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c962f442-2ed3-4d2a-b7b1-9e07d2c3ad18 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:35.080619 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-c962f442-2ed3-4d2a-b7b1-9e07d2c3ad18 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:35.088260 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-c962f442-2ed3-4d2a-b7b1-9e07d2c3ad18 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1382 microversion: 2.1 time: 0.082654 Oct 26 11:26:35.088830 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 408/828] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:35 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1382 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:35.754077 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-abc4e5f3-0366-4ed7-a368-5b0685c5b65b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:35.754684 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-abc4e5f3-0366-4ed7-a368-5b0685c5b65b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:35.760766 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-abc4e5f3-0366-4ed7-a368-5b0685c5b65b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:35.761245 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-abc4e5f3-0366-4ed7-a368-5b0685c5b65b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:35.761671 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-abc4e5f3-0366-4ed7-a368-5b0685c5b65b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:35.762353 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-abc4e5f3-0366-4ed7-a368-5b0685c5b65b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:35.762800 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-abc4e5f3-0366-4ed7-a368-5b0685c5b65b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:35.763248 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-abc4e5f3-0366-4ed7-a368-5b0685c5b65b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:35.891178 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-abc4e5f3-0366-4ed7-a368-5b0685c5b65b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:35.899563 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-abc4e5f3-0366-4ed7-a368-5b0685c5b65b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f" status: 200 len: 1365 microversion: 2.1 time: 0.149266 Oct 26 11:26:35.900188 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 421/829] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:35 2022] GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:36.112192 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-f9ab7b47-a68a-4fc2-acee-131ba8edbe09 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:36.112802 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-f9ab7b47-a68a-4fc2-acee-131ba8edbe09 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:36.119571 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f9ab7b47-a68a-4fc2-acee-131ba8edbe09 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:36.121165 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f9ab7b47-a68a-4fc2-acee-131ba8edbe09 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:36.121165 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f9ab7b47-a68a-4fc2-acee-131ba8edbe09 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:36.121165 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f9ab7b47-a68a-4fc2-acee-131ba8edbe09 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:36.121614 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f9ab7b47-a68a-4fc2-acee-131ba8edbe09 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:36.122037 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f9ab7b47-a68a-4fc2-acee-131ba8edbe09 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:36.188176 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-f9ab7b47-a68a-4fc2-acee-131ba8edbe09 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:36.196015 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-f9ab7b47-a68a-4fc2-acee-131ba8edbe09 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1219 microversion: 2.1 time: 0.087715 Oct 26 11:26:36.196618 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 409/830] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:36 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:36.922601 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-c504fc94-dcea-47ec-940e-8e23900f3176 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:36.923304 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-c504fc94-dcea-47ec-940e-8e23900f3176 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:36.929413 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c504fc94-dcea-47ec-940e-8e23900f3176 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:36.929897 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c504fc94-dcea-47ec-940e-8e23900f3176 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:36.930361 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c504fc94-dcea-47ec-940e-8e23900f3176 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:36.931075 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c504fc94-dcea-47ec-940e-8e23900f3176 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:36.931528 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c504fc94-dcea-47ec-940e-8e23900f3176 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:36.931953 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c504fc94-dcea-47ec-940e-8e23900f3176 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:37.066745 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-c504fc94-dcea-47ec-940e-8e23900f3176 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:37.074631 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-c504fc94-dcea-47ec-940e-8e23900f3176 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f" status: 200 len: 1365 microversion: 2.1 time: 0.155965 Oct 26 11:26:37.075271 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 422/831] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:36 2022] GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:37.219862 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a07901e1-db1c-4024-856d-fe8c880213ce tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:37.221338 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-a07901e1-db1c-4024-856d-fe8c880213ce tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:37.228185 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a07901e1-db1c-4024-856d-fe8c880213ce tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:37.228672 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a07901e1-db1c-4024-856d-fe8c880213ce tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:37.229199 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a07901e1-db1c-4024-856d-fe8c880213ce tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:37.229833 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a07901e1-db1c-4024-856d-fe8c880213ce tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:37.230285 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a07901e1-db1c-4024-856d-fe8c880213ce tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:37.230707 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a07901e1-db1c-4024-856d-fe8c880213ce tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:37.261543 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a07901e1-db1c-4024-856d-fe8c880213ce tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:37.262026 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a07901e1-db1c-4024-856d-fe8c880213ce tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:37.262456 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a07901e1-db1c-4024-856d-fe8c880213ce tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:37.262946 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.objects.instance [None req-a07901e1-db1c-4024-856d-fe8c880213ce tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lazy-loading 'fault' on Instance uuid e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 {{(pid=119305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:26:37.309988 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-a07901e1-db1c-4024-856d-fe8c880213ce tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce09c776cd77416091ea214b858afacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30976e8b35f436b84dc4488dcf5acaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:37.318950 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-a07901e1-db1c-4024-856d-fe8c880213ce tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 200 len: 1224 microversion: 2.1 time: 0.104894 Oct 26 11:26:37.335040 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 410/832] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:37 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 1224 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:38.098011 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-c8eba660-1459-483f-bde9-0457416729c3 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:38.098916 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-c8eba660-1459-483f-bde9-0457416729c3 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:38.105319 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c8eba660-1459-483f-bde9-0457416729c3 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:38.105803 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c8eba660-1459-483f-bde9-0457416729c3 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:38.106310 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c8eba660-1459-483f-bde9-0457416729c3 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:38.107065 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c8eba660-1459-483f-bde9-0457416729c3 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:38.107513 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c8eba660-1459-483f-bde9-0457416729c3 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:38.108432 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c8eba660-1459-483f-bde9-0457416729c3 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:38.238224 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-c8eba660-1459-483f-bde9-0457416729c3 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:38.245871 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-c8eba660-1459-483f-bde9-0457416729c3 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f" status: 200 len: 1365 microversion: 2.1 time: 0.151699 Oct 26 11:26:38.246434 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 423/833] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:38 2022] GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:38.342306 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-7c297eb9-75ed-4063-a472-e5600f0e473f tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:38.342945 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-7c297eb9-75ed-4063-a472-e5600f0e473f tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] [instance: e4b20a22-cb3b-4fb4-8b69-3b626cd6d991] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:38.349180 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7c297eb9-75ed-4063-a472-e5600f0e473f tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:38.349911 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7c297eb9-75ed-4063-a472-e5600f0e473f tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:38.350081 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7c297eb9-75ed-4063-a472-e5600f0e473f tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:38.350765 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7c297eb9-75ed-4063-a472-e5600f0e473f tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:38.351243 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7c297eb9-75ed-4063-a472-e5600f0e473f tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:38.351668 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7c297eb9-75ed-4063-a472-e5600f0e473f tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:38.365464 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.wsgi [None req-7c297eb9-75ed-4063-a472-e5600f0e473f tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] HTTP exception thrown: Instance e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 could not be found. Oct 26 11:26:38.367103 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-7c297eb9-75ed-4063-a472-e5600f0e473f tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Request method failure captured: Oct 26 11:26:38.367103 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: request: GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 HTTP/1.1 Oct 26 11:26:38.367103 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept: application/json Oct 26 11:26:38.367103 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept-Encoding: identity Oct 26 11:26:38.367103 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Connection: close Oct 26 11:26:38.367103 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Length: 0 Oct 26 11:26:38.367103 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Type: application/json Oct 26 11:26:38.367103 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Host: 10.222.0.42 Oct 26 11:26:38.367103 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Openstack-System-Scope: None Oct 26 11:26:38.367103 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: User-Agent: python-urllib3/1.26.12 Oct 26 11:26:38.367103 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Auth-Token: gAAAAABjWRfFyRFiaGFdpaIyUUw7r_RTOMTml3opjZV_83gxsSOgJUIDqzFmgp93KkGIrSDOeu9vp5oZLBY8SZStb4_BhnbZ0ExvfCmknv-nlo2ZRWyc4So4OzaC2a3azSi4y40dYuJb8noK0wVOM1xuj4XXKbEbXjKBiGiCmvf5NufJxh3WqDg Oct 26 11:26:38.367103 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Id: None Oct 26 11:26:38.367103 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Name: None Oct 26 11:26:38.367103 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Identity-Status: Confirmed Oct 26 11:26:38.367103 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Is-Admin-Project: True Oct 26 11:26:38.367103 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Id: default Oct 26 11:26:38.367103 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Name: Default Oct 26 11:26:38.367103 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Id: a30976e8b35f436b84dc4488dcf5acaf Oct 26 11:26:38.367103 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Name: tempest-TestShelveInstance-383840923 Oct 26 11:26:38.367103 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Role: member,reader Oct 26 11:26:38.367103 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Roles: member,reader Oct 26 11:26:38.368694 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a30976e8b35f436b84dc4488dcf5acaf", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a30976e8b35f436b84dc4488dcf5acaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a30976e8b35f436b84dc4488dcf5acaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a30976e8b35f436b84dc4488dcf5acaf"}]}] Oct 26 11:26:38.368694 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant: tempest-TestShelveInstance-383840923 Oct 26 11:26:38.368694 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Id: a30976e8b35f436b84dc4488dcf5acaf Oct 26 11:26:38.368694 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Name: tempest-TestShelveInstance-383840923 Oct 26 11:26:38.368694 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User: tempest-TestShelveInstance-383840923-project Oct 26 11:26:38.368694 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Id: default Oct 26 11:26:38.368694 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Name: Default Oct 26 11:26:38.368694 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Id: ce09c776cd77416091ea214b858afacd Oct 26 11:26:38.368694 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Name: tempest-TestShelveInstance-383840923-project Oct 26 11:26:38.368694 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: method: > Oct 26 11:26:38.368694 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: exception: Instance e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 could not be found. Oct 26 11:26:38.368694 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: action_args: {'id': 'e4b20a22-cb3b-4fb4-8b69-3b626cd6d991'} Oct 26 11:26:38.372611 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:26:38.372611 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:26:38.372611 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:26:38.372611 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:26:38.372611 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:26:38.372611 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:26:38.372611 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:26:38.372611 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:26:38.372611 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:26:38.372611 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:26:38.372611 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 could not be found. Oct 26 11:26:38.372611 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:26:38.372611 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:26:38.372611 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:26:38.372611 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:26:38.372611 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:26:38.372611 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:26:38.372611 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:26:38.372611 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:26:38.372611 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:26:38.378584 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:26:38.378584 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 11:26:38.378584 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 11:26:38.378584 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:26:38.378584 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:26:38.378584 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:26:38.378584 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:26:38.378584 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 could not be found. Oct 26 11:26:38.378584 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:26:38.378584 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:26:38.378584 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:26:38.378584 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:26:38.378584 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:26:38.378584 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:26:38.378584 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:26:38.378584 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:26:38.378584 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 could not be found. Oct 26 11:26:38.378584 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:26:38.379989 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-7c297eb9-75ed-4063-a472-e5600f0e473f tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Returning 404 to user: Instance e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 could not be found. {{(pid=119305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:26:38.379989 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-7c297eb9-75ed-4063-a472-e5600f0e473f tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991" status: 404 len: 111 microversion: 2.1 time: 0.030182 Oct 26 11:26:38.379989 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 411/834] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:38 2022] GET /compute/v2.1/servers/e4b20a22-cb3b-4fb4-8b69-3b626cd6d991 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:26:38.609580 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-138a0e46-615e-4d09-a127-b444cc556195 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] Calling method '.version_select at 0x7f6b937789d0>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:38.685049 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-138a0e46-615e-4d09-a127-b444cc556195 tempest-TestShelveInstance-383840923 tempest-TestShelveInstance-383840923-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2012182741" status: 202 len: 0 microversion: 2.1 time: 0.080434 Oct 26 11:26:38.685676 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 424/835] 10.222.0.42 () {58 vars in 1254 bytes} [Wed Oct 26 11:26:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2012182741 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 11:26:39.271542 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-6547e91a-a9b0-4fd4-9862-a77b26434ddf req-a81f1102-9c8b-45f5-9d31-ca04ba7267a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f58550-4456-4d0f-b050-e0be7959139f", "name": "network-vif-plugged", "status": "completed", "tag": "7b01f1f3-91ab-48bc-ba7f-676d9f2823c0"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:26:39.275597 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-e188b3ea-8507-4421-968d-166516cdbe12 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:39.275597 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-e188b3ea-8507-4421-968d-166516cdbe12 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:39.279732 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e188b3ea-8507-4421-968d-166516cdbe12 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:39.280569 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e188b3ea-8507-4421-968d-166516cdbe12 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:39.281458 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e188b3ea-8507-4421-968d-166516cdbe12 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:39.282417 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e188b3ea-8507-4421-968d-166516cdbe12 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:39.283231 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e188b3ea-8507-4421-968d-166516cdbe12 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:39.283850 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e188b3ea-8507-4421-968d-166516cdbe12 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:39.291069 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-6547e91a-a9b0-4fd4-9862-a77b26434ddf req-a81f1102-9c8b-45f5-9d31-ca04ba7267a6 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:39.291564 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-6547e91a-a9b0-4fd4-9862-a77b26434ddf req-a81f1102-9c8b-45f5-9d31-ca04ba7267a6 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:39.292676 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-6547e91a-a9b0-4fd4-9862-a77b26434ddf req-a81f1102-9c8b-45f5-9d31-ca04ba7267a6 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:39.310414 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-6547e91a-a9b0-4fd4-9862-a77b26434ddf req-a81f1102-9c8b-45f5-9d31-ca04ba7267a6 service nova] Creating event network-vif-plugged:7b01f1f3-91ab-48bc-ba7f-676d9f2823c0 for instance d7f58550-4456-4d0f-b050-e0be7959139f on hv-cinder-81558 Oct 26 11:26:39.324828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-6547e91a-a9b0-4fd4-9862-a77b26434ddf req-a81f1102-9c8b-45f5-9d31-ca04ba7267a6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057130 Oct 26 11:26:39.325456 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 425/836] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:26:39.458143 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-e188b3ea-8507-4421-968d-166516cdbe12 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:39.467756 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-e188b3ea-8507-4421-968d-166516cdbe12 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f" status: 200 len: 1365 microversion: 2.1 time: 0.199905 Oct 26 11:26:39.468452 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 412/837] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:39 2022] GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:40.495219 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-be980ef4-f384-43ca-af31-501cbe297873 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:40.497445 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-be980ef4-f384-43ca-af31-501cbe297873 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:40.508599 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-be980ef4-f384-43ca-af31-501cbe297873 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:40.509603 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-be980ef4-f384-43ca-af31-501cbe297873 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:40.510767 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-be980ef4-f384-43ca-af31-501cbe297873 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:40.511998 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-be980ef4-f384-43ca-af31-501cbe297873 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:40.512668 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-be980ef4-f384-43ca-af31-501cbe297873 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:40.513320 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-be980ef4-f384-43ca-af31-501cbe297873 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:40.726150 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-be980ef4-f384-43ca-af31-501cbe297873 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:40.738024 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-be980ef4-f384-43ca-af31-501cbe297873 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f" status: 200 len: 1365 microversion: 2.1 time: 0.249713 Oct 26 11:26:40.755903 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 426/838] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:40 2022] GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f => generated 1365 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:41.775331 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-4d2ebb35-9685-4877-9e12-937f3f7eb47b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:41.776771 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-4d2ebb35-9685-4877-9e12-937f3f7eb47b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:41.784561 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4d2ebb35-9685-4877-9e12-937f3f7eb47b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:41.785134 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4d2ebb35-9685-4877-9e12-937f3f7eb47b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:41.785582 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4d2ebb35-9685-4877-9e12-937f3f7eb47b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:41.786441 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4d2ebb35-9685-4877-9e12-937f3f7eb47b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:41.787102 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4d2ebb35-9685-4877-9e12-937f3f7eb47b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:41.787897 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4d2ebb35-9685-4877-9e12-937f3f7eb47b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:41.942496 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-4d2ebb35-9685-4877-9e12-937f3f7eb47b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:41.950237 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-4d2ebb35-9685-4877-9e12-937f3f7eb47b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f" status: 200 len: 1555 microversion: 2.1 time: 0.183228 Oct 26 11:26:41.950857 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 413/839] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:26:41 2022] GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f => generated 1555 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:26:41.972767 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-89b9b4dd-0af7-4721-8ece-af563c51c271 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:41.973280 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-89b9b4dd-0af7-4721-8ece-af563c51c271 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:41.979945 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-89b9b4dd-0af7-4721-8ece-af563c51c271 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:41.980998 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-89b9b4dd-0af7-4721-8ece-af563c51c271 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:41.981563 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-89b9b4dd-0af7-4721-8ece-af563c51c271 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:41.982391 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-89b9b4dd-0af7-4721-8ece-af563c51c271 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:41.983259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-89b9b4dd-0af7-4721-8ece-af563c51c271 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:41.983724 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-89b9b4dd-0af7-4721-8ece-af563c51c271 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:42.088557 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-89b9b4dd-0af7-4721-8ece-af563c51c271 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.119536 Oct 26 11:26:42.096320 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 427/840] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Oct 26 11:26:41 2022] GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:26:43.376424 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-9c24a07f-0cb6-4601-909f-b04f96bb298d req-9ae279ac-603c-4c3f-9298-0db862646ffe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7f58550-4456-4d0f-b050-e0be7959139f", "tag": "7b01f1f3-91ab-48bc-ba7f-676d9f2823c0"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:26:43.391647 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-9c24a07f-0cb6-4601-909f-b04f96bb298d req-9ae279ac-603c-4c3f-9298-0db862646ffe service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:43.392213 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-9c24a07f-0cb6-4601-909f-b04f96bb298d req-9ae279ac-603c-4c3f-9298-0db862646ffe service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:43.392799 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-9c24a07f-0cb6-4601-909f-b04f96bb298d req-9ae279ac-603c-4c3f-9298-0db862646ffe service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:43.404610 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-9c24a07f-0cb6-4601-909f-b04f96bb298d req-9ae279ac-603c-4c3f-9298-0db862646ffe service nova] Creating event network-changed:7b01f1f3-91ab-48bc-ba7f-676d9f2823c0 for instance d7f58550-4456-4d0f-b050-e0be7959139f on hv-cinder-81558 Oct 26 11:26:43.410592 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-9c24a07f-0cb6-4601-909f-b04f96bb298d req-9ae279ac-603c-4c3f-9298-0db862646ffe service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041574 Oct 26 11:26:43.411446 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 414/841] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:26:43.583981 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-13db4733-557f-4dcd-ab2c-6c1311a647ad tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:43.584485 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-13db4733-557f-4dcd-ab2c-6c1311a647ad tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:43.595277 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-13db4733-557f-4dcd-ab2c-6c1311a647ad tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:43.595710 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-13db4733-557f-4dcd-ab2c-6c1311a647ad tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:43.596882 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-13db4733-557f-4dcd-ab2c-6c1311a647ad tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:43.596882 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-13db4733-557f-4dcd-ab2c-6c1311a647ad tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:43.597319 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-13db4733-557f-4dcd-ab2c-6c1311a647ad tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:43.597744 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-13db4733-557f-4dcd-ab2c-6c1311a647ad tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:43.648054 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-13db4733-557f-4dcd-ab2c-6c1311a647ad tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd/ips" status: 200 len: 153 microversion: 2.20 time: 0.068411 Oct 26 11:26:43.648832 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 428/842] 10.222.0.42 () {60 vars in 1289 bytes} [Wed Oct 26 11:26:43 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd/ips => generated 153 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 26 11:26:45.874796 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-54a716cd-250f-48ef-823a-291270b9f091 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:26:45.875516 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-54a716cd-250f-48ef-823a-291270b9f091 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:45.881897 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-54a716cd-250f-48ef-823a-291270b9f091 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:45.882461 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-54a716cd-250f-48ef-823a-291270b9f091 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:45.883039 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-54a716cd-250f-48ef-823a-291270b9f091 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:45.883800 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-54a716cd-250f-48ef-823a-291270b9f091 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:45.884357 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-54a716cd-250f-48ef-823a-291270b9f091 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:45.885049 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-54a716cd-250f-48ef-823a-291270b9f091 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:45.911051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.objects.instance [None req-54a716cd-250f-48ef-823a-291270b9f091 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lazy-loading 'flavor' on Instance uuid 032aed92-2b14-4791-8612-a0261e6d77fd {{(pid=119305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:26:46.547014 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-54a716cd-250f-48ef-823a-291270b9f091 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "POST /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd/action" status: 202 len: 0 microversion: 2.20 time: 0.679164 Oct 26 11:26:46.547638 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 415/843] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Oct 26 11:26:45 2022] POST /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd/action => generated 0 bytes in 681 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 26 11:26:46.556259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-21f19676-97a0-4cc2-a58f-75bc07d9c39a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:46.562381 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-21f19676-97a0-4cc2-a58f-75bc07d9c39a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:46.563522 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-21f19676-97a0-4cc2-a58f-75bc07d9c39a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:46.564003 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-21f19676-97a0-4cc2-a58f-75bc07d9c39a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:46.564432 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-21f19676-97a0-4cc2-a58f-75bc07d9c39a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:46.565145 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-21f19676-97a0-4cc2-a58f-75bc07d9c39a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:46.565591 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-21f19676-97a0-4cc2-a58f-75bc07d9c39a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:46.566005 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-21f19676-97a0-4cc2-a58f-75bc07d9c39a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:46.701320 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-21f19676-97a0-4cc2-a58f-75bc07d9c39a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:46.710189 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-21f19676-97a0-4cc2-a58f-75bc07d9c39a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:46.711815 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-21f19676-97a0-4cc2-a58f-75bc07d9c39a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:46.713015 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-21f19676-97a0-4cc2-a58f-75bc07d9c39a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1724 microversion: 2.20 time: 0.160897 Oct 26 11:26:46.713894 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 429/844] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:26:46 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:26:47.741679 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a51c50d2-f9b6-46c6-bf10-13afb48069a4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:47.743130 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-a51c50d2-f9b6-46c6-bf10-13afb48069a4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:47.751229 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a51c50d2-f9b6-46c6-bf10-13afb48069a4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:47.751866 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a51c50d2-f9b6-46c6-bf10-13afb48069a4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:47.752293 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a51c50d2-f9b6-46c6-bf10-13afb48069a4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:47.753068 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a51c50d2-f9b6-46c6-bf10-13afb48069a4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:47.753662 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a51c50d2-f9b6-46c6-bf10-13afb48069a4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:47.754158 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a51c50d2-f9b6-46c6-bf10-13afb48069a4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:47.886896 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-a51c50d2-f9b6-46c6-bf10-13afb48069a4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:47.895471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-a51c50d2-f9b6-46c6-bf10-13afb48069a4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:47.897169 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-a51c50d2-f9b6-46c6-bf10-13afb48069a4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:47.898313 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-a51c50d2-f9b6-46c6-bf10-13afb48069a4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1724 microversion: 2.20 time: 0.161719 Oct 26 11:26:47.898889 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 416/845] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:26:47 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:26:48.929672 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-1ce1d361-4ad0-481d-94e0-6284f708ea49 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:48.930280 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-1ce1d361-4ad0-481d-94e0-6284f708ea49 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:48.937361 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1ce1d361-4ad0-481d-94e0-6284f708ea49 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:48.937843 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1ce1d361-4ad0-481d-94e0-6284f708ea49 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:48.938275 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1ce1d361-4ad0-481d-94e0-6284f708ea49 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:48.938999 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1ce1d361-4ad0-481d-94e0-6284f708ea49 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:48.939451 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1ce1d361-4ad0-481d-94e0-6284f708ea49 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:48.939944 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1ce1d361-4ad0-481d-94e0-6284f708ea49 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:49.092727 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-1ce1d361-4ad0-481d-94e0-6284f708ea49 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:49.101447 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-1ce1d361-4ad0-481d-94e0-6284f708ea49 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:49.102993 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-1ce1d361-4ad0-481d-94e0-6284f708ea49 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:49.104354 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-1ce1d361-4ad0-481d-94e0-6284f708ea49 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1724 microversion: 2.20 time: 0.178541 Oct 26 11:26:49.105416 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 430/846] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:26:48 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:26:50.131222 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-2718c941-2959-4b03-a5b3-8072a7e0f7b0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:50.131827 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-2718c941-2959-4b03-a5b3-8072a7e0f7b0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:50.138163 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2718c941-2959-4b03-a5b3-8072a7e0f7b0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:50.138646 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2718c941-2959-4b03-a5b3-8072a7e0f7b0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:50.139271 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2718c941-2959-4b03-a5b3-8072a7e0f7b0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:50.139922 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2718c941-2959-4b03-a5b3-8072a7e0f7b0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:50.140369 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2718c941-2959-4b03-a5b3-8072a7e0f7b0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:50.140792 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2718c941-2959-4b03-a5b3-8072a7e0f7b0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:50.270505 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-2718c941-2959-4b03-a5b3-8072a7e0f7b0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:50.279102 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-2718c941-2959-4b03-a5b3-8072a7e0f7b0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:50.280586 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-2718c941-2959-4b03-a5b3-8072a7e0f7b0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:50.281770 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-2718c941-2959-4b03-a5b3-8072a7e0f7b0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1724 microversion: 2.20 time: 0.154672 Oct 26 11:26:50.282365 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 417/847] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:26:50 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 11:26:51.307711 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-690ad92d-d367-4246-a1d3-6744d26a2429 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:51.308406 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-690ad92d-d367-4246-a1d3-6744d26a2429 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:51.315366 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-690ad92d-d367-4246-a1d3-6744d26a2429 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:51.315919 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-690ad92d-d367-4246-a1d3-6744d26a2429 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:51.316357 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-690ad92d-d367-4246-a1d3-6744d26a2429 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:51.317042 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-690ad92d-d367-4246-a1d3-6744d26a2429 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:51.317666 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-690ad92d-d367-4246-a1d3-6744d26a2429 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:51.318093 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-690ad92d-d367-4246-a1d3-6744d26a2429 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:51.447065 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-690ad92d-d367-4246-a1d3-6744d26a2429 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:51.455659 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-690ad92d-d367-4246-a1d3-6744d26a2429 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:51.457157 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-690ad92d-d367-4246-a1d3-6744d26a2429 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:51.458310 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-690ad92d-d367-4246-a1d3-6744d26a2429 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1724 microversion: 2.20 time: 0.154482 Oct 26 11:26:51.458992 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 431/848] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:26:51 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:26:52.483675 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-9aea2c32-4cfc-4696-a806-42c94284d2cc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:52.484340 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-9aea2c32-4cfc-4696-a806-42c94284d2cc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:52.490613 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9aea2c32-4cfc-4696-a806-42c94284d2cc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:52.491137 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9aea2c32-4cfc-4696-a806-42c94284d2cc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:52.491910 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9aea2c32-4cfc-4696-a806-42c94284d2cc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:52.492251 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9aea2c32-4cfc-4696-a806-42c94284d2cc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:52.492701 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9aea2c32-4cfc-4696-a806-42c94284d2cc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:52.493126 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9aea2c32-4cfc-4696-a806-42c94284d2cc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:52.774881 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-9aea2c32-4cfc-4696-a806-42c94284d2cc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:52.778405 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:26:52.783730 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-9aea2c32-4cfc-4696-a806-42c94284d2cc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:52.785225 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-9aea2c32-4cfc-4696-a806-42c94284d2cc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:52.786432 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-9aea2c32-4cfc-4696-a806-42c94284d2cc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1724 microversion: 2.20 time: 0.306672 Oct 26 11:26:52.791618 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 418/849] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:26:52 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1724 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:26:53.816231 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-81ded7d2-5655-417d-9e9b-5af4dc5fafb5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:53.816840 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-81ded7d2-5655-417d-9e9b-5af4dc5fafb5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:53.823561 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-81ded7d2-5655-417d-9e9b-5af4dc5fafb5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:53.824044 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-81ded7d2-5655-417d-9e9b-5af4dc5fafb5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:53.824478 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-81ded7d2-5655-417d-9e9b-5af4dc5fafb5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:53.825160 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-81ded7d2-5655-417d-9e9b-5af4dc5fafb5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:53.825610 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-81ded7d2-5655-417d-9e9b-5af4dc5fafb5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:53.826027 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-81ded7d2-5655-417d-9e9b-5af4dc5fafb5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:53.954438 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-81ded7d2-5655-417d-9e9b-5af4dc5fafb5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:53.962402 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-81ded7d2-5655-417d-9e9b-5af4dc5fafb5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:53.963895 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-81ded7d2-5655-417d-9e9b-5af4dc5fafb5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:53.965044 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-81ded7d2-5655-417d-9e9b-5af4dc5fafb5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1724 microversion: 2.20 time: 0.153311 Oct 26 11:26:53.965610 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 432/850] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:26:53 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:26:54.990398 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-cf1dc90a-ffdd-4464-980b-ae6db7f4ca0f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:54.991044 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-cf1dc90a-ffdd-4464-980b-ae6db7f4ca0f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:54.998423 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cf1dc90a-ffdd-4464-980b-ae6db7f4ca0f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:54.998942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cf1dc90a-ffdd-4464-980b-ae6db7f4ca0f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:54.999388 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cf1dc90a-ffdd-4464-980b-ae6db7f4ca0f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:55.000566 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cf1dc90a-ffdd-4464-980b-ae6db7f4ca0f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:55.001127 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cf1dc90a-ffdd-4464-980b-ae6db7f4ca0f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:55.001556 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cf1dc90a-ffdd-4464-980b-ae6db7f4ca0f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:55.127961 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-cf1dc90a-ffdd-4464-980b-ae6db7f4ca0f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:55.135703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-cf1dc90a-ffdd-4464-980b-ae6db7f4ca0f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:55.137120 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-cf1dc90a-ffdd-4464-980b-ae6db7f4ca0f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:55.138248 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-cf1dc90a-ffdd-4464-980b-ae6db7f4ca0f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1724 microversion: 2.20 time: 0.151906 Oct 26 11:26:55.138787 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 419/851] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:26:54 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:26:56.163945 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-27292768-f168-4267-adde-76f7f3bddf6e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:56.164578 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-27292768-f168-4267-adde-76f7f3bddf6e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:56.170892 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-27292768-f168-4267-adde-76f7f3bddf6e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:56.171378 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-27292768-f168-4267-adde-76f7f3bddf6e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:56.171804 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-27292768-f168-4267-adde-76f7f3bddf6e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:56.172969 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-27292768-f168-4267-adde-76f7f3bddf6e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:56.173419 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-27292768-f168-4267-adde-76f7f3bddf6e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:56.173869 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-27292768-f168-4267-adde-76f7f3bddf6e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:56.300363 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-27292768-f168-4267-adde-76f7f3bddf6e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:56.308518 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-27292768-f168-4267-adde-76f7f3bddf6e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:56.310011 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-27292768-f168-4267-adde-76f7f3bddf6e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:56.311201 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-27292768-f168-4267-adde-76f7f3bddf6e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1724 microversion: 2.20 time: 0.151210 Oct 26 11:26:56.311769 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 433/852] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:26:56 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:26:57.337458 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-d5589a4a-a47c-4c95-9bfb-786116d6d339 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:57.338071 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-d5589a4a-a47c-4c95-9bfb-786116d6d339 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:57.345193 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d5589a4a-a47c-4c95-9bfb-786116d6d339 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:57.345704 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d5589a4a-a47c-4c95-9bfb-786116d6d339 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:57.346138 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d5589a4a-a47c-4c95-9bfb-786116d6d339 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:57.346835 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d5589a4a-a47c-4c95-9bfb-786116d6d339 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:57.347312 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d5589a4a-a47c-4c95-9bfb-786116d6d339 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:57.347740 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d5589a4a-a47c-4c95-9bfb-786116d6d339 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:57.478101 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-d5589a4a-a47c-4c95-9bfb-786116d6d339 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:57.489660 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-d5589a4a-a47c-4c95-9bfb-786116d6d339 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:57.491120 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-d5589a4a-a47c-4c95-9bfb-786116d6d339 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:57.492308 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-d5589a4a-a47c-4c95-9bfb-786116d6d339 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1724 microversion: 2.20 time: 0.158792 Oct 26 11:26:57.492848 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 420/853] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:26:57 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:26:58.517443 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-0f3c8a5c-6b35-433a-bc14-512012e2ee36 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:58.518087 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-0f3c8a5c-6b35-433a-bc14-512012e2ee36 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:58.525027 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0f3c8a5c-6b35-433a-bc14-512012e2ee36 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:58.525510 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0f3c8a5c-6b35-433a-bc14-512012e2ee36 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:58.525940 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0f3c8a5c-6b35-433a-bc14-512012e2ee36 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:58.526628 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0f3c8a5c-6b35-433a-bc14-512012e2ee36 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:58.527111 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0f3c8a5c-6b35-433a-bc14-512012e2ee36 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:58.527527 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0f3c8a5c-6b35-433a-bc14-512012e2ee36 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:58.658050 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-0f3c8a5c-6b35-433a-bc14-512012e2ee36 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:58.666517 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-0f3c8a5c-6b35-433a-bc14-512012e2ee36 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:58.668006 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-0f3c8a5c-6b35-433a-bc14-512012e2ee36 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:58.669160 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-0f3c8a5c-6b35-433a-bc14-512012e2ee36 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1724 microversion: 2.20 time: 0.155644 Oct 26 11:26:58.669722 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 434/854] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:26:58 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:26:59.695614 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-c141fae2-b80a-4584-9498-dce3dedd35d7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:26:59.696218 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-c141fae2-b80a-4584-9498-dce3dedd35d7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:26:59.702280 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c141fae2-b80a-4584-9498-dce3dedd35d7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:59.702770 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c141fae2-b80a-4584-9498-dce3dedd35d7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:59.703381 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c141fae2-b80a-4584-9498-dce3dedd35d7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:59.704163 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c141fae2-b80a-4584-9498-dce3dedd35d7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:26:59.704555 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c141fae2-b80a-4584-9498-dce3dedd35d7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:26:59.704977 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c141fae2-b80a-4584-9498-dce3dedd35d7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:26:59.838396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-c141fae2-b80a-4584-9498-dce3dedd35d7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:59.846516 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-c141fae2-b80a-4584-9498-dce3dedd35d7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:59.847982 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-c141fae2-b80a-4584-9498-dce3dedd35d7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:26:59.849194 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-c141fae2-b80a-4584-9498-dce3dedd35d7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1724 microversion: 2.20 time: 0.157513 Oct 26 11:26:59.849738 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 421/855] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:26:59 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:00.874836 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-4e194c4b-109e-45f1-af28-f9cab9442584 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:00.875450 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-4e194c4b-109e-45f1-af28-f9cab9442584 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:00.882423 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4e194c4b-109e-45f1-af28-f9cab9442584 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:00.882947 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4e194c4b-109e-45f1-af28-f9cab9442584 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:00.883446 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4e194c4b-109e-45f1-af28-f9cab9442584 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:00.884060 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4e194c4b-109e-45f1-af28-f9cab9442584 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:00.884600 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4e194c4b-109e-45f1-af28-f9cab9442584 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:00.884908 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4e194c4b-109e-45f1-af28-f9cab9442584 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:01.011349 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-4e194c4b-109e-45f1-af28-f9cab9442584 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:01.020367 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-4e194c4b-109e-45f1-af28-f9cab9442584 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:01.022171 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-4e194c4b-109e-45f1-af28-f9cab9442584 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:01.023363 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-4e194c4b-109e-45f1-af28-f9cab9442584 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1724 microversion: 2.20 time: 0.152484 Oct 26 11:27:01.023945 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 435/856] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:00 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:02.048536 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-bd0c67fd-8e6e-4f81-943c-94c3b3cef376 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:02.049071 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-bd0c67fd-8e6e-4f81-943c-94c3b3cef376 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:02.055406 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bd0c67fd-8e6e-4f81-943c-94c3b3cef376 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:02.060219 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bd0c67fd-8e6e-4f81-943c-94c3b3cef376 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:02.060219 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bd0c67fd-8e6e-4f81-943c-94c3b3cef376 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:02.060219 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bd0c67fd-8e6e-4f81-943c-94c3b3cef376 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:02.060219 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bd0c67fd-8e6e-4f81-943c-94c3b3cef376 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:02.060585 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bd0c67fd-8e6e-4f81-943c-94c3b3cef376 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:02.187358 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-bd0c67fd-8e6e-4f81-943c-94c3b3cef376 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:02.195741 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-bd0c67fd-8e6e-4f81-943c-94c3b3cef376 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:02.197253 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-bd0c67fd-8e6e-4f81-943c-94c3b3cef376 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:02.198491 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-bd0c67fd-8e6e-4f81-943c-94c3b3cef376 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1724 microversion: 2.20 time: 0.154007 Oct 26 11:27:02.199165 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 422/857] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:02 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:03.224186 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-fb9de88f-52b0-4f4d-9b9e-db7b7854abf5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:03.224773 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-fb9de88f-52b0-4f4d-9b9e-db7b7854abf5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:03.231321 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fb9de88f-52b0-4f4d-9b9e-db7b7854abf5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:03.231795 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fb9de88f-52b0-4f4d-9b9e-db7b7854abf5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:03.232222 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fb9de88f-52b0-4f4d-9b9e-db7b7854abf5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:03.232900 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fb9de88f-52b0-4f4d-9b9e-db7b7854abf5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:03.233345 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fb9de88f-52b0-4f4d-9b9e-db7b7854abf5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:03.233761 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fb9de88f-52b0-4f4d-9b9e-db7b7854abf5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:03.236413 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=97 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:27:03.361531 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-fb9de88f-52b0-4f4d-9b9e-db7b7854abf5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:03.370085 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-fb9de88f-52b0-4f4d-9b9e-db7b7854abf5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:03.371606 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-fb9de88f-52b0-4f4d-9b9e-db7b7854abf5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:03.372756 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-fb9de88f-52b0-4f4d-9b9e-db7b7854abf5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1745 microversion: 2.20 time: 0.153089 Oct 26 11:27:03.373310 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 436/858] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:03 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:04.398400 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a2a49e5b-1130-4e5d-b0f7-5e48d7198de4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:04.399031 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-a2a49e5b-1130-4e5d-b0f7-5e48d7198de4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:04.405355 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a2a49e5b-1130-4e5d-b0f7-5e48d7198de4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:04.405815 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a2a49e5b-1130-4e5d-b0f7-5e48d7198de4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:04.406245 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a2a49e5b-1130-4e5d-b0f7-5e48d7198de4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:04.406956 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a2a49e5b-1130-4e5d-b0f7-5e48d7198de4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:04.407408 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a2a49e5b-1130-4e5d-b0f7-5e48d7198de4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:04.407826 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a2a49e5b-1130-4e5d-b0f7-5e48d7198de4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:04.534925 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-a2a49e5b-1130-4e5d-b0f7-5e48d7198de4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:04.543038 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-a2a49e5b-1130-4e5d-b0f7-5e48d7198de4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:04.544493 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-a2a49e5b-1130-4e5d-b0f7-5e48d7198de4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:04.545628 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-a2a49e5b-1130-4e5d-b0f7-5e48d7198de4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1745 microversion: 2.20 time: 0.151426 Oct 26 11:27:04.546178 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 423/859] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:04 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:05.571603 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e4205c80-313d-470c-ada8-1a477c9781df tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:05.572217 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-e4205c80-313d-470c-ada8-1a477c9781df tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:05.574577 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:27:05.579268 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e4205c80-313d-470c-ada8-1a477c9781df tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:05.579752 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e4205c80-313d-470c-ada8-1a477c9781df tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:05.580185 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e4205c80-313d-470c-ada8-1a477c9781df tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:05.581523 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e4205c80-313d-470c-ada8-1a477c9781df tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:05.581979 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e4205c80-313d-470c-ada8-1a477c9781df tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:05.582403 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e4205c80-313d-470c-ada8-1a477c9781df tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:05.717897 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-e4205c80-313d-470c-ada8-1a477c9781df tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:05.733841 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-e4205c80-313d-470c-ada8-1a477c9781df tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:05.737748 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-e4205c80-313d-470c-ada8-1a477c9781df tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:05.737748 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-e4205c80-313d-470c-ada8-1a477c9781df tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1745 microversion: 2.20 time: 0.169004 Oct 26 11:27:05.738629 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 437/860] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:05 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:06.763686 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-31117dfb-ce73-4fe3-a3c0-421a0a14d745 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:06.764295 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-31117dfb-ce73-4fe3-a3c0-421a0a14d745 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:06.766541 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_api:SELECT=36 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:27:06.772033 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-31117dfb-ce73-4fe3-a3c0-421a0a14d745 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:06.772520 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-31117dfb-ce73-4fe3-a3c0-421a0a14d745 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:06.772953 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-31117dfb-ce73-4fe3-a3c0-421a0a14d745 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:06.773640 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-31117dfb-ce73-4fe3-a3c0-421a0a14d745 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:06.774097 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-31117dfb-ce73-4fe3-a3c0-421a0a14d745 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:06.774517 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-31117dfb-ce73-4fe3-a3c0-421a0a14d745 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:06.907626 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-31117dfb-ce73-4fe3-a3c0-421a0a14d745 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:06.915658 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-31117dfb-ce73-4fe3-a3c0-421a0a14d745 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:06.917076 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-31117dfb-ce73-4fe3-a3c0-421a0a14d745 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:06.918215 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-31117dfb-ce73-4fe3-a3c0-421a0a14d745 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1745 microversion: 2.20 time: 0.158452 Oct 26 11:27:06.918765 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 424/861] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:06 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:07.400714 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-d3294486-64d5-40cd-a002-fc5e96752a56 req-b32ddda5-737c-4db0-8137-1b14e0ee25c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "032aed92-2b14-4791-8612-a0261e6d77fd", "name": "network-vif-plugged", "status": "completed", "tag": "d48eea34-8900-4e01-bcd5-3b4a5f2f3dd1"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:27:07.411404 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-d3294486-64d5-40cd-a002-fc5e96752a56 req-b32ddda5-737c-4db0-8137-1b14e0ee25c9 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:07.412018 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-d3294486-64d5-40cd-a002-fc5e96752a56 req-b32ddda5-737c-4db0-8137-1b14e0ee25c9 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:07.412441 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-d3294486-64d5-40cd-a002-fc5e96752a56 req-b32ddda5-737c-4db0-8137-1b14e0ee25c9 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:07.424076 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-d3294486-64d5-40cd-a002-fc5e96752a56 req-b32ddda5-737c-4db0-8137-1b14e0ee25c9 service nova] Creating event network-vif-plugged:d48eea34-8900-4e01-bcd5-3b4a5f2f3dd1 for instance 032aed92-2b14-4791-8612-a0261e6d77fd on hv-cinder-81558 Oct 26 11:27:07.429649 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-d3294486-64d5-40cd-a002-fc5e96752a56 req-b32ddda5-737c-4db0-8137-1b14e0ee25c9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037512 Oct 26 11:27:07.430493 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 438/862] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:27:07.943478 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-dde2dc91-8877-4380-b2b5-405fcfe1b088 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:07.944248 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-dde2dc91-8877-4380-b2b5-405fcfe1b088 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:07.950787 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-dde2dc91-8877-4380-b2b5-405fcfe1b088 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:07.951329 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-dde2dc91-8877-4380-b2b5-405fcfe1b088 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:07.951773 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-dde2dc91-8877-4380-b2b5-405fcfe1b088 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:07.952474 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-dde2dc91-8877-4380-b2b5-405fcfe1b088 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:07.952931 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-dde2dc91-8877-4380-b2b5-405fcfe1b088 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:07.953359 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-dde2dc91-8877-4380-b2b5-405fcfe1b088 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:08.138557 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-dde2dc91-8877-4380-b2b5-405fcfe1b088 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:08.147509 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-dde2dc91-8877-4380-b2b5-405fcfe1b088 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:08.148931 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-dde2dc91-8877-4380-b2b5-405fcfe1b088 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:08.150068 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-dde2dc91-8877-4380-b2b5-405fcfe1b088 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1745 microversion: 2.20 time: 0.210610 Oct 26 11:27:08.150613 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 425/863] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:07 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1745 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:09.177053 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-80dd1a39-40ee-4abf-a214-f510273512af tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:09.177819 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-80dd1a39-40ee-4abf-a214-f510273512af tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:09.184325 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-80dd1a39-40ee-4abf-a214-f510273512af tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:09.184799 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-80dd1a39-40ee-4abf-a214-f510273512af tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:09.185248 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-80dd1a39-40ee-4abf-a214-f510273512af tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:09.188306 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-80dd1a39-40ee-4abf-a214-f510273512af tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:09.188765 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-80dd1a39-40ee-4abf-a214-f510273512af tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:09.189309 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-80dd1a39-40ee-4abf-a214-f510273512af tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:09.318999 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-80dd1a39-40ee-4abf-a214-f510273512af tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:09.327038 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-80dd1a39-40ee-4abf-a214-f510273512af tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:09.328532 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-80dd1a39-40ee-4abf-a214-f510273512af tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:09.329680 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-80dd1a39-40ee-4abf-a214-f510273512af tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1740 microversion: 2.20 time: 0.157710 Oct 26 11:27:09.330232 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 439/864] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:09 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:10.357546 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-68a94bdc-5dd6-41b1-9cb4-1610df9a51bb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:10.358791 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-68a94bdc-5dd6-41b1-9cb4-1610df9a51bb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:10.365621 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-68a94bdc-5dd6-41b1-9cb4-1610df9a51bb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:10.366108 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-68a94bdc-5dd6-41b1-9cb4-1610df9a51bb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:10.368134 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-68a94bdc-5dd6-41b1-9cb4-1610df9a51bb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:10.368134 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-68a94bdc-5dd6-41b1-9cb4-1610df9a51bb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:10.368134 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-68a94bdc-5dd6-41b1-9cb4-1610df9a51bb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:10.368134 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-68a94bdc-5dd6-41b1-9cb4-1610df9a51bb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:10.509333 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-68a94bdc-5dd6-41b1-9cb4-1610df9a51bb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:10.519155 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-68a94bdc-5dd6-41b1-9cb4-1610df9a51bb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:10.520937 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-68a94bdc-5dd6-41b1-9cb4-1610df9a51bb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:10.522968 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-68a94bdc-5dd6-41b1-9cb4-1610df9a51bb tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1740 microversion: 2.20 time: 0.169852 Oct 26 11:27:10.535885 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 426/865] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:10 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:11.560621 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-570fa415-3aca-4faf-9ef9-f1ed4333c5b3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:11.562074 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-570fa415-3aca-4faf-9ef9-f1ed4333c5b3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:11.570136 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-570fa415-3aca-4faf-9ef9-f1ed4333c5b3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:11.571381 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-570fa415-3aca-4faf-9ef9-f1ed4333c5b3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:11.572043 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-570fa415-3aca-4faf-9ef9-f1ed4333c5b3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:11.572997 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-570fa415-3aca-4faf-9ef9-f1ed4333c5b3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:11.573563 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-570fa415-3aca-4faf-9ef9-f1ed4333c5b3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:11.574434 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-570fa415-3aca-4faf-9ef9-f1ed4333c5b3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:11.734065 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-570fa415-3aca-4faf-9ef9-f1ed4333c5b3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:11.748350 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-570fa415-3aca-4faf-9ef9-f1ed4333c5b3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:11.751015 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-570fa415-3aca-4faf-9ef9-f1ed4333c5b3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:11.752885 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-570fa415-3aca-4faf-9ef9-f1ed4333c5b3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1740 microversion: 2.20 time: 0.199173 Oct 26 11:27:11.763062 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 440/866] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:11 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:12.780026 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-3a2bbfc2-33b4-47ec-877c-9528c4b4a427 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:12.780942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-3a2bbfc2-33b4-47ec-877c-9528c4b4a427 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:12.788602 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3a2bbfc2-33b4-47ec-877c-9528c4b4a427 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:12.789263 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3a2bbfc2-33b4-47ec-877c-9528c4b4a427 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:12.789699 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3a2bbfc2-33b4-47ec-877c-9528c4b4a427 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:12.790415 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3a2bbfc2-33b4-47ec-877c-9528c4b4a427 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:12.790893 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3a2bbfc2-33b4-47ec-877c-9528c4b4a427 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:12.791322 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3a2bbfc2-33b4-47ec-877c-9528c4b4a427 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:12.930285 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-3a2bbfc2-33b4-47ec-877c-9528c4b4a427 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:12.939170 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-3a2bbfc2-33b4-47ec-877c-9528c4b4a427 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:12.940840 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-3a2bbfc2-33b4-47ec-877c-9528c4b4a427 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:12.942194 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-3a2bbfc2-33b4-47ec-877c-9528c4b4a427 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1740 microversion: 2.20 time: 0.166239 Oct 26 11:27:12.942748 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 427/867] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:12 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:13.975653 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-a82ac535-8508-4c1e-8c2a-41d6bff9868c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:13.977778 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-a82ac535-8508-4c1e-8c2a-41d6bff9868c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:13.984498 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a82ac535-8508-4c1e-8c2a-41d6bff9868c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:13.985160 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a82ac535-8508-4c1e-8c2a-41d6bff9868c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:13.985601 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a82ac535-8508-4c1e-8c2a-41d6bff9868c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:13.986362 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a82ac535-8508-4c1e-8c2a-41d6bff9868c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:13.986842 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a82ac535-8508-4c1e-8c2a-41d6bff9868c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:13.987903 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a82ac535-8508-4c1e-8c2a-41d6bff9868c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:14.147839 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-a82ac535-8508-4c1e-8c2a-41d6bff9868c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:14.157796 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-a82ac535-8508-4c1e-8c2a-41d6bff9868c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:14.159916 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-a82ac535-8508-4c1e-8c2a-41d6bff9868c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:14.161275 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-a82ac535-8508-4c1e-8c2a-41d6bff9868c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1740 microversion: 2.20 time: 0.197478 Oct 26 11:27:14.179610 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 441/868] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:13 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:15.187958 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-0243ac64-3dbc-4fc9-bd14-511caa044923 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:15.189248 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-0243ac64-3dbc-4fc9-bd14-511caa044923 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:15.195895 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0243ac64-3dbc-4fc9-bd14-511caa044923 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:15.196389 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0243ac64-3dbc-4fc9-bd14-511caa044923 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:15.196829 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0243ac64-3dbc-4fc9-bd14-511caa044923 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:15.197571 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0243ac64-3dbc-4fc9-bd14-511caa044923 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:15.198051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0243ac64-3dbc-4fc9-bd14-511caa044923 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:15.198476 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0243ac64-3dbc-4fc9-bd14-511caa044923 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:15.338567 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-0243ac64-3dbc-4fc9-bd14-511caa044923 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:15.347772 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-0243ac64-3dbc-4fc9-bd14-511caa044923 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:15.349236 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-0243ac64-3dbc-4fc9-bd14-511caa044923 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:15.350412 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-0243ac64-3dbc-4fc9-bd14-511caa044923 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1740 microversion: 2.20 time: 0.166826 Oct 26 11:27:15.351176 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 428/869] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:15 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:16.380029 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-2feab0c0-e031-43be-af1d-37defc51c3e3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:16.380879 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-2feab0c0-e031-43be-af1d-37defc51c3e3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:16.389326 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2feab0c0-e031-43be-af1d-37defc51c3e3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:16.389865 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2feab0c0-e031-43be-af1d-37defc51c3e3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:16.390297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2feab0c0-e031-43be-af1d-37defc51c3e3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:16.391012 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2feab0c0-e031-43be-af1d-37defc51c3e3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:16.391462 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2feab0c0-e031-43be-af1d-37defc51c3e3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:16.391960 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2feab0c0-e031-43be-af1d-37defc51c3e3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:16.532149 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-2feab0c0-e031-43be-af1d-37defc51c3e3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:16.541168 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-2feab0c0-e031-43be-af1d-37defc51c3e3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:16.542646 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-2feab0c0-e031-43be-af1d-37defc51c3e3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:16.543841 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-2feab0c0-e031-43be-af1d-37defc51c3e3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1740 microversion: 2.20 time: 0.169333 Oct 26 11:27:16.544404 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 442/870] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:16 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:17.569955 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-0b4fbf99-928b-4e8b-a9ab-b0f380c40f38 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:17.570790 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-0b4fbf99-928b-4e8b-a9ab-b0f380c40f38 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:17.577378 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0b4fbf99-928b-4e8b-a9ab-b0f380c40f38 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:17.577866 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0b4fbf99-928b-4e8b-a9ab-b0f380c40f38 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:17.578303 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0b4fbf99-928b-4e8b-a9ab-b0f380c40f38 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:17.579346 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0b4fbf99-928b-4e8b-a9ab-b0f380c40f38 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:17.580003 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0b4fbf99-928b-4e8b-a9ab-b0f380c40f38 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:17.580636 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0b4fbf99-928b-4e8b-a9ab-b0f380c40f38 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:17.722124 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-0b4fbf99-928b-4e8b-a9ab-b0f380c40f38 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:17.731229 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-0b4fbf99-928b-4e8b-a9ab-b0f380c40f38 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:17.738331 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-0b4fbf99-928b-4e8b-a9ab-b0f380c40f38 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:17.739855 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-0b4fbf99-928b-4e8b-a9ab-b0f380c40f38 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1740 microversion: 2.20 time: 0.173877 Oct 26 11:27:17.759768 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 429/871] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:17 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:18.770608 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-172ac3f3-e7a5-4b13-b61a-92ecf01dc261 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:18.771189 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-172ac3f3-e7a5-4b13-b61a-92ecf01dc261 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:18.782410 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-172ac3f3-e7a5-4b13-b61a-92ecf01dc261 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:18.785303 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-172ac3f3-e7a5-4b13-b61a-92ecf01dc261 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:18.785760 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-172ac3f3-e7a5-4b13-b61a-92ecf01dc261 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:18.786479 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-172ac3f3-e7a5-4b13-b61a-92ecf01dc261 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:18.786962 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-172ac3f3-e7a5-4b13-b61a-92ecf01dc261 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:18.787390 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-172ac3f3-e7a5-4b13-b61a-92ecf01dc261 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:19.016316 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-172ac3f3-e7a5-4b13-b61a-92ecf01dc261 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:19.032561 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-172ac3f3-e7a5-4b13-b61a-92ecf01dc261 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:19.034072 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-172ac3f3-e7a5-4b13-b61a-92ecf01dc261 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:19.038858 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-172ac3f3-e7a5-4b13-b61a-92ecf01dc261 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1740 microversion: 2.20 time: 0.272183 Oct 26 11:27:19.041066 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 443/872] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:18 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1740 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 11:27:20.067718 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-aff7d063-97a8-45ce-b6e7-39b31f7beb5c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:20.068334 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-aff7d063-97a8-45ce-b6e7-39b31f7beb5c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:20.074911 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-aff7d063-97a8-45ce-b6e7-39b31f7beb5c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:20.075405 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-aff7d063-97a8-45ce-b6e7-39b31f7beb5c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:20.076154 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-aff7d063-97a8-45ce-b6e7-39b31f7beb5c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:20.076652 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-aff7d063-97a8-45ce-b6e7-39b31f7beb5c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:20.077546 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-aff7d063-97a8-45ce-b6e7-39b31f7beb5c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:20.077644 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-aff7d063-97a8-45ce-b6e7-39b31f7beb5c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:20.237874 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-aff7d063-97a8-45ce-b6e7-39b31f7beb5c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:20.246277 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-aff7d063-97a8-45ce-b6e7-39b31f7beb5c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:20.248075 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-aff7d063-97a8-45ce-b6e7-39b31f7beb5c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:20.249515 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-aff7d063-97a8-45ce-b6e7-39b31f7beb5c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1740 microversion: 2.20 time: 0.185776 Oct 26 11:27:20.259178 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 430/873] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:20 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:21.275953 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-95ced14e-0acf-4ef0-a8df-490d2bc274f2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:21.276491 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-95ced14e-0acf-4ef0-a8df-490d2bc274f2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:21.282798 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-95ced14e-0acf-4ef0-a8df-490d2bc274f2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:21.283306 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-95ced14e-0acf-4ef0-a8df-490d2bc274f2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:21.283737 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-95ced14e-0acf-4ef0-a8df-490d2bc274f2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:21.284447 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-95ced14e-0acf-4ef0-a8df-490d2bc274f2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:21.284896 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-95ced14e-0acf-4ef0-a8df-490d2bc274f2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:21.285313 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-95ced14e-0acf-4ef0-a8df-490d2bc274f2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:21.411348 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-95ced14e-0acf-4ef0-a8df-490d2bc274f2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:21.419476 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-95ced14e-0acf-4ef0-a8df-490d2bc274f2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:21.420931 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-95ced14e-0acf-4ef0-a8df-490d2bc274f2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:21.422095 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-95ced14e-0acf-4ef0-a8df-490d2bc274f2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1740 microversion: 2.20 time: 0.150329 Oct 26 11:27:21.422647 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 444/874] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:21 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1740 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:22.448087 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-f1b756c5-c2ff-45fd-98e0-7261ce5dd4a3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:22.448721 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-f1b756c5-c2ff-45fd-98e0-7261ce5dd4a3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:22.455096 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f1b756c5-c2ff-45fd-98e0-7261ce5dd4a3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:22.455586 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f1b756c5-c2ff-45fd-98e0-7261ce5dd4a3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:22.456521 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f1b756c5-c2ff-45fd-98e0-7261ce5dd4a3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:22.457209 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f1b756c5-c2ff-45fd-98e0-7261ce5dd4a3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:22.457661 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f1b756c5-c2ff-45fd-98e0-7261ce5dd4a3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:22.458085 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f1b756c5-c2ff-45fd-98e0-7261ce5dd4a3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:22.587963 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-f1b756c5-c2ff-45fd-98e0-7261ce5dd4a3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:22.596867 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-f1b756c5-c2ff-45fd-98e0-7261ce5dd4a3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:22.598308 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-f1b756c5-c2ff-45fd-98e0-7261ce5dd4a3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:22.599498 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-f1b756c5-c2ff-45fd-98e0-7261ce5dd4a3 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1740 microversion: 2.20 time: 0.155326 Oct 26 11:27:22.600045 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 431/875] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:22 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:23.624369 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-46a54361-6126-42f7-9b34-19a58202ad32 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:23.624974 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-46a54361-6126-42f7-9b34-19a58202ad32 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:23.631376 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-46a54361-6126-42f7-9b34-19a58202ad32 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:23.631863 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-46a54361-6126-42f7-9b34-19a58202ad32 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:23.632293 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-46a54361-6126-42f7-9b34-19a58202ad32 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:23.632976 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-46a54361-6126-42f7-9b34-19a58202ad32 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:23.633426 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-46a54361-6126-42f7-9b34-19a58202ad32 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:23.633880 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-46a54361-6126-42f7-9b34-19a58202ad32 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:23.760381 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-46a54361-6126-42f7-9b34-19a58202ad32 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:23.768470 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-46a54361-6126-42f7-9b34-19a58202ad32 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:23.770457 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-46a54361-6126-42f7-9b34-19a58202ad32 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:23.771892 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-46a54361-6126-42f7-9b34-19a58202ad32 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1722 microversion: 2.20 time: 0.151190 Oct 26 11:27:23.772451 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 445/876] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:23 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:24.797483 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-48c8d2b8-bcc9-4d0b-a6d5-f002f119a48c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:24.798086 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-48c8d2b8-bcc9-4d0b-a6d5-f002f119a48c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:24.805248 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-48c8d2b8-bcc9-4d0b-a6d5-f002f119a48c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:24.805728 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-48c8d2b8-bcc9-4d0b-a6d5-f002f119a48c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:24.806158 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-48c8d2b8-bcc9-4d0b-a6d5-f002f119a48c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:24.806870 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-48c8d2b8-bcc9-4d0b-a6d5-f002f119a48c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:24.807507 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-48c8d2b8-bcc9-4d0b-a6d5-f002f119a48c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:24.808090 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-48c8d2b8-bcc9-4d0b-a6d5-f002f119a48c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:24.942559 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-48c8d2b8-bcc9-4d0b-a6d5-f002f119a48c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:24.951373 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-48c8d2b8-bcc9-4d0b-a6d5-f002f119a48c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:24.952720 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-48c8d2b8-bcc9-4d0b-a6d5-f002f119a48c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:24.953909 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-48c8d2b8-bcc9-4d0b-a6d5-f002f119a48c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1722 microversion: 2.20 time: 0.160475 Oct 26 11:27:24.954473 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 432/877] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:24 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:25.155696 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-46d86a1e-e11c-487d-8f47-6dd188bf20c9 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1979161598", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1078387089", "security_groups": [{"name": "tempest-secgroup-smoke-1592834590"}], "block_device_mapping_v2": [{"uuid": "b460f597-de2a-4e51-afd8-e363b591065b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5b1f4268-e846-46c0-b38f-b877c6621858"}]}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:27:25.278403 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.network.neutron [None req-46d86a1e-e11c-487d-8f47-6dd188bf20c9 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] validate_networks() for [('5b1f4268-e846-46c0-b38f-b877c6621858', None, None, None, None, None)] {{(pid=119306) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 11:27:25.469613 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-953cd443-b7b9-4a3c-9fbf-625d5d6252cc req-6d044536-221a-4a31-bece-8091ab3d1469 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "032aed92-2b14-4791-8612-a0261e6d77fd", "name": "network-vif-unplugged", "status": "completed", "tag": "d48eea34-8900-4e01-bcd5-3b4a5f2f3dd1"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:27:25.486561 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-953cd443-b7b9-4a3c-9fbf-625d5d6252cc req-6d044536-221a-4a31-bece-8091ab3d1469 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:25.487422 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-953cd443-b7b9-4a3c-9fbf-625d5d6252cc req-6d044536-221a-4a31-bece-8091ab3d1469 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:25.488300 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-953cd443-b7b9-4a3c-9fbf-625d5d6252cc req-6d044536-221a-4a31-bece-8091ab3d1469 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:25.502129 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-953cd443-b7b9-4a3c-9fbf-625d5d6252cc req-6d044536-221a-4a31-bece-8091ab3d1469 service nova] Creating event network-vif-unplugged:d48eea34-8900-4e01-bcd5-3b4a5f2f3dd1 for instance 032aed92-2b14-4791-8612-a0261e6d77fd on hv-cinder-81558 Oct 26 11:27:25.507068 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-953cd443-b7b9-4a3c-9fbf-625d5d6252cc req-6d044536-221a-4a31-bece-8091ab3d1469 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041250 Oct 26 11:27:25.507940 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 433/878] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:27:25.713497 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-46d86a1e-e11c-487d-8f47-6dd188bf20c9 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Flavor limits 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 11:27:25.713943 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-46d86a1e-e11c-487d-8f47-6dd188bf20c9 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Image limits 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 11:27:25.714415 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-46d86a1e-e11c-487d-8f47-6dd188bf20c9 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Flavor pref 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 11:27:25.714836 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-46d86a1e-e11c-487d-8f47-6dd188bf20c9 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Image pref 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 11:27:25.715322 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-46d86a1e-e11c-487d-8f47-6dd188bf20c9 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 11:27:25.725061 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-46d86a1e-e11c-487d-8f47-6dd188bf20c9 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:25.725547 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-46d86a1e-e11c-487d-8f47-6dd188bf20c9 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:25.725982 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-46d86a1e-e11c-487d-8f47-6dd188bf20c9 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:25.727482 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-46d86a1e-e11c-487d-8f47-6dd188bf20c9 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:25.727961 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-46d86a1e-e11c-487d-8f47-6dd188bf20c9 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:25.728394 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-46d86a1e-e11c-487d-8f47-6dd188bf20c9 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:25.745754 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-46d86a1e-e11c-487d-8f47-6dd188bf20c9 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Getting quotas for project e378bfab9d91492e81320139fed867c6. Resources: {'cores', 'instances', 'ram'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:27:25.750245 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-46d86a1e-e11c-487d-8f47-6dd188bf20c9 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Getting quotas for user 1f737b4d0531425cbc803fcd15a3ea1f and project e378bfab9d91492e81320139fed867c6. Resources: {'cores', 'instances', 'ram'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:27:25.813201 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-46d86a1e-e11c-487d-8f47-6dd188bf20c9 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Going to run 1 instances... {{(pid=119306) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 11:27:25.815517 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-46d86a1e-e11c-487d-8f47-6dd188bf20c9 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b460f597-de2a-4e51-afd8-e363b591065b',volume_size=None,volume_type=None)] {{(pid=119306) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 11:27:25.982249 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-2217e495-65a0-44a4-880d-3afc2dd2d719 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:25.985273 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-2217e495-65a0-44a4-880d-3afc2dd2d719 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:25.991307 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2217e495-65a0-44a4-880d-3afc2dd2d719 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:25.991807 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2217e495-65a0-44a4-880d-3afc2dd2d719 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:25.992245 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2217e495-65a0-44a4-880d-3afc2dd2d719 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:25.992939 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2217e495-65a0-44a4-880d-3afc2dd2d719 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:25.993387 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2217e495-65a0-44a4-880d-3afc2dd2d719 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:25.993806 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2217e495-65a0-44a4-880d-3afc2dd2d719 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:26.131692 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-2217e495-65a0-44a4-880d-3afc2dd2d719 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:26.140014 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-2217e495-65a0-44a4-880d-3afc2dd2d719 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:26.141467 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-2217e495-65a0-44a4-880d-3afc2dd2d719 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:26.142617 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-2217e495-65a0-44a4-880d-3afc2dd2d719 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1725 microversion: 2.20 time: 0.166258 Oct 26 11:27:26.143235 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 434/879] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:25 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 11:27:26.172043 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a167415d-e21c-4746-8574-78d28fabaa46 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28cc3336-41aa-4932-b799-ec7d75d427ec"}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:27:26.174428 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-a167415d-e21c-4746-8574-78d28fabaa46 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:26.193744 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a167415d-e21c-4746-8574-78d28fabaa46 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:26.193744 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a167415d-e21c-4746-8574-78d28fabaa46 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:26.193744 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a167415d-e21c-4746-8574-78d28fabaa46 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:26.193744 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a167415d-e21c-4746-8574-78d28fabaa46 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:26.194065 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a167415d-e21c-4746-8574-78d28fabaa46 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:26.194065 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a167415d-e21c-4746-8574-78d28fabaa46 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:26.287453 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:27:26.288190 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-46d86a1e-e11c-487d-8f47-6dd188bf20c9 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.136177 Oct 26 11:27:26.289708 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 446/880] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Oct 26 11:27:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 11:27:26.301800 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-3caf2e6f-12c4-4c5a-b615-252febb14cfc tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:26.302759 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-3caf2e6f-12c4-4c5a-b615-252febb14cfc tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:26.360372 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-3caf2e6f-12c4-4c5a-b615-252febb14cfc tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:26.369030 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-3caf2e6f-12c4-4c5a-b615-252febb14cfc tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2" status: 200 len: 1095 microversion: 2.1 time: 0.071999 Oct 26 11:27:26.369637 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 447/881] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:27:26 2022] GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:27:27.342175 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-a167415d-e21c-4746-8574-78d28fabaa46 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "POST /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.174194 Oct 26 11:27:27.345940 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 435/882] 10.222.0.42 () {62 vars in 1364 bytes} [Wed Oct 26 11:27:26 2022] POST /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd/os-volume_attachments => generated 188 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 26 11:27:27.393281 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-a1a7c363-f879-416f-b8bf-d3acb10ffbeb tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:27.394539 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-a1a7c363-f879-416f-b8bf-d3acb10ffbeb tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:27.403457 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a1a7c363-f879-416f-b8bf-d3acb10ffbeb tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:27.404624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a1a7c363-f879-416f-b8bf-d3acb10ffbeb tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:27.405075 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a1a7c363-f879-416f-b8bf-d3acb10ffbeb tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:27.405790 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a1a7c363-f879-416f-b8bf-d3acb10ffbeb tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:27.406266 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a1a7c363-f879-416f-b8bf-d3acb10ffbeb tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:27.406659 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a1a7c363-f879-416f-b8bf-d3acb10ffbeb tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:27.474296 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-a1a7c363-f879-416f-b8bf-d3acb10ffbeb tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:27.481218 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-26f55bd2-227c-4b2e-8528-487a6eed37d2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:27.481743 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-26f55bd2-227c-4b2e-8528-487a6eed37d2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:27.482066 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-a1a7c363-f879-416f-b8bf-d3acb10ffbeb tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2" status: 200 len: 1145 microversion: 2.1 time: 0.094002 Oct 26 11:27:27.482690 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 448/883] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:27:27 2022] GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 => generated 1145 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:27:27.489490 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-26f55bd2-227c-4b2e-8528-487a6eed37d2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:27.489979 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-26f55bd2-227c-4b2e-8528-487a6eed37d2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:27.494547 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-26f55bd2-227c-4b2e-8528-487a6eed37d2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:27.494547 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-26f55bd2-227c-4b2e-8528-487a6eed37d2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:27.494547 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-26f55bd2-227c-4b2e-8528-487a6eed37d2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:27.494547 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-26f55bd2-227c-4b2e-8528-487a6eed37d2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:28.272719 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-26f55bd2-227c-4b2e-8528-487a6eed37d2 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "DELETE /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd/os-volume_attachments/28cc3336-41aa-4932-b799-ec7d75d427ec" status: 202 len: 0 microversion: 2.20 time: 0.795345 Oct 26 11:27:28.273240 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 436/884] 10.222.0.42 () {60 vars in 1457 bytes} [Wed Oct 26 11:27:27 2022] DELETE /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd/os-volume_attachments/28cc3336-41aa-4932-b799-ec7d75d427ec => generated 0 bytes in 797 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 26 11:27:28.339210 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-ed10766a-540d-4de4-9a8b-d18f93f9ea70 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:27:28.339797 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-ed10766a-540d-4de4-9a8b-d18f93f9ea70 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:28.345503 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ed10766a-540d-4de4-9a8b-d18f93f9ea70 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:28.345973 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ed10766a-540d-4de4-9a8b-d18f93f9ea70 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:28.346406 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ed10766a-540d-4de4-9a8b-d18f93f9ea70 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:28.347121 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ed10766a-540d-4de4-9a8b-d18f93f9ea70 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:28.347578 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ed10766a-540d-4de4-9a8b-d18f93f9ea70 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:28.348639 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ed10766a-540d-4de4-9a8b-d18f93f9ea70 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:28.389906 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-ed10766a-540d-4de4-9a8b-d18f93f9ea70 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119306) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 26 11:27:28.506633 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-25050dcc-207f-47e7-9cf9-3ea57159a429 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:28.507430 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-25050dcc-207f-47e7-9cf9-3ea57159a429 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:28.513998 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-25050dcc-207f-47e7-9cf9-3ea57159a429 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:28.514495 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-25050dcc-207f-47e7-9cf9-3ea57159a429 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:28.514971 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-25050dcc-207f-47e7-9cf9-3ea57159a429 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:28.515968 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-25050dcc-207f-47e7-9cf9-3ea57159a429 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:28.516738 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-25050dcc-207f-47e7-9cf9-3ea57159a429 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:28.517468 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-25050dcc-207f-47e7-9cf9-3ea57159a429 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:28.600591 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-25050dcc-207f-47e7-9cf9-3ea57159a429 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:28.608670 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-25050dcc-207f-47e7-9cf9-3ea57159a429 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2" status: 200 len: 1201 microversion: 2.1 time: 0.106087 Oct 26 11:27:28.609240 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 437/885] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:27:28 2022] GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 => generated 1201 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:27:28.680513 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-ed10766a-540d-4de4-9a8b-d18f93f9ea70 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "POST /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd/action" status: 202 len: 0 microversion: 2.20 time: 0.345203 Oct 26 11:27:28.681215 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 449/886] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Oct 26 11:27:28 2022] POST /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 26 11:27:28.690110 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-3e321555-0ccd-417a-b25b-2f73d819e6a4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:28.690844 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-3e321555-0ccd-417a-b25b-2f73d819e6a4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:28.697867 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3e321555-0ccd-417a-b25b-2f73d819e6a4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:28.698778 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3e321555-0ccd-417a-b25b-2f73d819e6a4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:28.703773 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3e321555-0ccd-417a-b25b-2f73d819e6a4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:28.703773 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3e321555-0ccd-417a-b25b-2f73d819e6a4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:28.703773 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3e321555-0ccd-417a-b25b-2f73d819e6a4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:28.703773 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3e321555-0ccd-417a-b25b-2f73d819e6a4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:28.871068 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-3e321555-0ccd-417a-b25b-2f73d819e6a4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:28.884874 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-3e321555-0ccd-417a-b25b-2f73d819e6a4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:28.884874 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-3e321555-0ccd-417a-b25b-2f73d819e6a4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:28.884874 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-3e321555-0ccd-417a-b25b-2f73d819e6a4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1673 microversion: 2.20 time: 0.198613 Oct 26 11:27:28.885433 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 438/887] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:28 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1673 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 11:27:29.635839 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-5a57e33e-b490-415b-8133-876c6273e3a3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:29.636595 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-5a57e33e-b490-415b-8133-876c6273e3a3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:29.645606 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5a57e33e-b490-415b-8133-876c6273e3a3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:29.645606 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5a57e33e-b490-415b-8133-876c6273e3a3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:29.645606 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5a57e33e-b490-415b-8133-876c6273e3a3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:29.645606 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5a57e33e-b490-415b-8133-876c6273e3a3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:29.646236 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5a57e33e-b490-415b-8133-876c6273e3a3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:29.646799 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5a57e33e-b490-415b-8133-876c6273e3a3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:29.820373 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-5a57e33e-b490-415b-8133-876c6273e3a3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:29.828417 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-5a57e33e-b490-415b-8133-876c6273e3a3 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2" status: 200 len: 1279 microversion: 2.1 time: 0.196413 Oct 26 11:27:29.829289 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 450/888] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:27:29 2022] GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 => generated 1279 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:27:29.912322 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-c4ba2e2f-2b27-44d6-a8b0-efdfb3a2d487 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:29.912936 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-c4ba2e2f-2b27-44d6-a8b0-efdfb3a2d487 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:29.923585 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c4ba2e2f-2b27-44d6-a8b0-efdfb3a2d487 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:29.924481 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c4ba2e2f-2b27-44d6-a8b0-efdfb3a2d487 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:29.924926 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c4ba2e2f-2b27-44d6-a8b0-efdfb3a2d487 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:29.925633 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c4ba2e2f-2b27-44d6-a8b0-efdfb3a2d487 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:29.926094 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c4ba2e2f-2b27-44d6-a8b0-efdfb3a2d487 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:29.926514 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c4ba2e2f-2b27-44d6-a8b0-efdfb3a2d487 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:30.095073 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-c4ba2e2f-2b27-44d6-a8b0-efdfb3a2d487 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:30.104368 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-c4ba2e2f-2b27-44d6-a8b0-efdfb3a2d487 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:30.106024 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-c4ba2e2f-2b27-44d6-a8b0-efdfb3a2d487 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:30.107470 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-c4ba2e2f-2b27-44d6-a8b0-efdfb3a2d487 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1673 microversion: 2.20 time: 0.200421 Oct 26 11:27:30.108535 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 439/889] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:29 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1673 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:30.464007 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-dbc075a8-33b8-4627-b116-c87a5591886e req-7df32ea8-8229-443c-aad7-e717db7725f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aba99081-fcee-4a22-80e9-7c08f92a03d2", "tag": "5b41cdbe-3c75-436a-bb3e-d85764fc830a"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:27:30.473774 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-dbc075a8-33b8-4627-b116-c87a5591886e req-7df32ea8-8229-443c-aad7-e717db7725f6 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:30.474298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-dbc075a8-33b8-4627-b116-c87a5591886e req-7df32ea8-8229-443c-aad7-e717db7725f6 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:30.474712 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-dbc075a8-33b8-4627-b116-c87a5591886e req-7df32ea8-8229-443c-aad7-e717db7725f6 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:30.485725 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-dbc075a8-33b8-4627-b116-c87a5591886e req-7df32ea8-8229-443c-aad7-e717db7725f6 service nova] Creating event network-changed:5b41cdbe-3c75-436a-bb3e-d85764fc830a for instance aba99081-fcee-4a22-80e9-7c08f92a03d2 on hv-cinder-81558 Oct 26 11:27:30.490905 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-dbc075a8-33b8-4627-b116-c87a5591886e req-7df32ea8-8229-443c-aad7-e717db7725f6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030686 Oct 26 11:27:30.491513 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 451/890] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:27:30.852760 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-7da9b266-c1c7-427f-a607-18551d38f010 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:30.853480 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-7da9b266-c1c7-427f-a607-18551d38f010 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:30.859665 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7da9b266-c1c7-427f-a607-18551d38f010 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:30.862109 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7da9b266-c1c7-427f-a607-18551d38f010 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:30.862109 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7da9b266-c1c7-427f-a607-18551d38f010 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:30.862109 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7da9b266-c1c7-427f-a607-18551d38f010 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:30.862109 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7da9b266-c1c7-427f-a607-18551d38f010 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:30.862473 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7da9b266-c1c7-427f-a607-18551d38f010 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:31.085693 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-7da9b266-c1c7-427f-a607-18551d38f010 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:31.093514 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-7da9b266-c1c7-427f-a607-18551d38f010 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2" status: 200 len: 1267 microversion: 2.1 time: 0.245252 Oct 26 11:27:31.093935 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 440/891] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:27:30 2022] GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 => generated 1267 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:27:31.134577 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-8ea259b3-b798-42c9-8d7e-73222edc41b4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:31.135303 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-8ea259b3-b798-42c9-8d7e-73222edc41b4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:31.141280 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8ea259b3-b798-42c9-8d7e-73222edc41b4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:31.141750 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8ea259b3-b798-42c9-8d7e-73222edc41b4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:31.142177 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8ea259b3-b798-42c9-8d7e-73222edc41b4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:31.142869 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8ea259b3-b798-42c9-8d7e-73222edc41b4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:31.143317 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8ea259b3-b798-42c9-8d7e-73222edc41b4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:31.143733 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8ea259b3-b798-42c9-8d7e-73222edc41b4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:31.276497 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-8ea259b3-b798-42c9-8d7e-73222edc41b4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:31.284565 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-8ea259b3-b798-42c9-8d7e-73222edc41b4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:31.287263 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-8ea259b3-b798-42c9-8d7e-73222edc41b4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:31.288671 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-8ea259b3-b798-42c9-8d7e-73222edc41b4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1731 microversion: 2.20 time: 0.158911 Oct 26 11:27:31.289241 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 452/892] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:31 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:32.117733 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-398c9af1-d29e-4d9b-9e35-bf8c6da2e404 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:32.118962 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-398c9af1-d29e-4d9b-9e35-bf8c6da2e404 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:32.125517 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-398c9af1-d29e-4d9b-9e35-bf8c6da2e404 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:32.126011 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-398c9af1-d29e-4d9b-9e35-bf8c6da2e404 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:32.126453 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-398c9af1-d29e-4d9b-9e35-bf8c6da2e404 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:32.127180 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-398c9af1-d29e-4d9b-9e35-bf8c6da2e404 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:32.127639 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-398c9af1-d29e-4d9b-9e35-bf8c6da2e404 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:32.128067 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-398c9af1-d29e-4d9b-9e35-bf8c6da2e404 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:32.264867 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-398c9af1-d29e-4d9b-9e35-bf8c6da2e404 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:32.272996 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-398c9af1-d29e-4d9b-9e35-bf8c6da2e404 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2" status: 200 len: 1267 microversion: 2.1 time: 0.159816 Oct 26 11:27:32.273570 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 441/893] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:27:32 2022] GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:27:32.316449 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-404ef0db-bde1-41d1-8eb0-69aecbe37d68 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:32.317574 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-404ef0db-bde1-41d1-8eb0-69aecbe37d68 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:32.324025 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-404ef0db-bde1-41d1-8eb0-69aecbe37d68 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:32.324513 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-404ef0db-bde1-41d1-8eb0-69aecbe37d68 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:32.324949 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-404ef0db-bde1-41d1-8eb0-69aecbe37d68 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:32.325645 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-404ef0db-bde1-41d1-8eb0-69aecbe37d68 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:32.326097 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-404ef0db-bde1-41d1-8eb0-69aecbe37d68 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:32.326521 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-404ef0db-bde1-41d1-8eb0-69aecbe37d68 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:32.469537 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-404ef0db-bde1-41d1-8eb0-69aecbe37d68 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:32.478355 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-404ef0db-bde1-41d1-8eb0-69aecbe37d68 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:32.481679 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-404ef0db-bde1-41d1-8eb0-69aecbe37d68 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:32.481679 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-404ef0db-bde1-41d1-8eb0-69aecbe37d68 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1731 microversion: 2.20 time: 0.168664 Oct 26 11:27:32.481679 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 453/894] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:32 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:33.295425 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-43ea1c1c-8e7d-4430-86b8-87392b343f6e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:33.296038 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-43ea1c1c-8e7d-4430-86b8-87392b343f6e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:33.302657 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-43ea1c1c-8e7d-4430-86b8-87392b343f6e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:33.303204 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-43ea1c1c-8e7d-4430-86b8-87392b343f6e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:33.303634 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-43ea1c1c-8e7d-4430-86b8-87392b343f6e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:33.304459 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-43ea1c1c-8e7d-4430-86b8-87392b343f6e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:33.305037 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-43ea1c1c-8e7d-4430-86b8-87392b343f6e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:33.305460 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-43ea1c1c-8e7d-4430-86b8-87392b343f6e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:33.444188 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-43ea1c1c-8e7d-4430-86b8-87392b343f6e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:33.451803 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-43ea1c1c-8e7d-4430-86b8-87392b343f6e tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2" status: 200 len: 1267 microversion: 2.1 time: 0.160672 Oct 26 11:27:33.452368 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 442/895] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:27:33 2022] GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:27:33.507576 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-341e5184-94b6-4760-a5a0-427aaed05bb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:33.508193 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-341e5184-94b6-4760-a5a0-427aaed05bb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:33.514237 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-341e5184-94b6-4760-a5a0-427aaed05bb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:33.514722 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-341e5184-94b6-4760-a5a0-427aaed05bb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:33.515224 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-341e5184-94b6-4760-a5a0-427aaed05bb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:33.515965 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-341e5184-94b6-4760-a5a0-427aaed05bb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:33.521986 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-341e5184-94b6-4760-a5a0-427aaed05bb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:33.521986 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-341e5184-94b6-4760-a5a0-427aaed05bb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:33.521986 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:27:33.684303 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-341e5184-94b6-4760-a5a0-427aaed05bb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:33.702509 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-341e5184-94b6-4760-a5a0-427aaed05bb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:33.712618 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-341e5184-94b6-4760-a5a0-427aaed05bb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:33.714406 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-341e5184-94b6-4760-a5a0-427aaed05bb0 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1731 microversion: 2.20 time: 0.210992 Oct 26 11:27:33.726056 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 454/896] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:33 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1731 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 11:27:34.475447 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-d6a28ede-5802-4493-a441-871945ef8549 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:34.476225 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-d6a28ede-5802-4493-a441-871945ef8549 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:34.482917 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d6a28ede-5802-4493-a441-871945ef8549 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:34.484186 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d6a28ede-5802-4493-a441-871945ef8549 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:34.484186 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d6a28ede-5802-4493-a441-871945ef8549 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:34.484538 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d6a28ede-5802-4493-a441-871945ef8549 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:34.484983 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d6a28ede-5802-4493-a441-871945ef8549 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:34.485446 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d6a28ede-5802-4493-a441-871945ef8549 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:34.626330 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-d6a28ede-5802-4493-a441-871945ef8549 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:34.634242 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-d6a28ede-5802-4493-a441-871945ef8549 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2" status: 200 len: 1267 microversion: 2.1 time: 0.162957 Oct 26 11:27:34.634838 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 443/897] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:27:34 2022] GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:27:34.748955 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-655f5ce0-dbdd-4479-9179-3bcb560eba59 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:34.749567 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-655f5ce0-dbdd-4479-9179-3bcb560eba59 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:34.756332 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-655f5ce0-dbdd-4479-9179-3bcb560eba59 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:34.756815 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-655f5ce0-dbdd-4479-9179-3bcb560eba59 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:34.757284 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-655f5ce0-dbdd-4479-9179-3bcb560eba59 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:34.757976 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-655f5ce0-dbdd-4479-9179-3bcb560eba59 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:34.758427 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-655f5ce0-dbdd-4479-9179-3bcb560eba59 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:34.758901 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-655f5ce0-dbdd-4479-9179-3bcb560eba59 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:35.043951 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-655f5ce0-dbdd-4479-9179-3bcb560eba59 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:35.052311 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-655f5ce0-dbdd-4479-9179-3bcb560eba59 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:35.053787 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-655f5ce0-dbdd-4479-9179-3bcb560eba59 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:35.054984 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-655f5ce0-dbdd-4479-9179-3bcb560eba59 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1731 microversion: 2.20 time: 0.310005 Oct 26 11:27:35.055552 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 455/898] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:34 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1731 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:35.663021 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-303771cf-0a90-41ff-83df-ae330525da02 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:35.663758 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-303771cf-0a90-41ff-83df-ae330525da02 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:35.674725 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-303771cf-0a90-41ff-83df-ae330525da02 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:35.675268 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-303771cf-0a90-41ff-83df-ae330525da02 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:35.675978 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-303771cf-0a90-41ff-83df-ae330525da02 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:35.676704 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-303771cf-0a90-41ff-83df-ae330525da02 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:35.677870 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-303771cf-0a90-41ff-83df-ae330525da02 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:35.678308 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-303771cf-0a90-41ff-83df-ae330525da02 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:35.930676 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-303771cf-0a90-41ff-83df-ae330525da02 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:35.938732 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-303771cf-0a90-41ff-83df-ae330525da02 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2" status: 200 len: 1267 microversion: 2.1 time: 0.282211 Oct 26 11:27:35.947197 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 444/899] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:27:35 2022] GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 => generated 1267 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:27:36.080160 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-c41d00ee-c939-42ab-b438-9e2a95a18b39 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:36.080825 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-c41d00ee-c939-42ab-b438-9e2a95a18b39 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:36.085220 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell0:SELECT=2 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:27:36.086661 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:27:36.089925 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c41d00ee-c939-42ab-b438-9e2a95a18b39 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:36.090415 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c41d00ee-c939-42ab-b438-9e2a95a18b39 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:36.090867 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c41d00ee-c939-42ab-b438-9e2a95a18b39 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:36.091681 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c41d00ee-c939-42ab-b438-9e2a95a18b39 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:36.092220 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c41d00ee-c939-42ab-b438-9e2a95a18b39 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:36.092998 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c41d00ee-c939-42ab-b438-9e2a95a18b39 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:36.253130 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-c41d00ee-c939-42ab-b438-9e2a95a18b39 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:36.262355 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-c41d00ee-c939-42ab-b438-9e2a95a18b39 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:36.264087 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-c41d00ee-c939-42ab-b438-9e2a95a18b39 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:36.265438 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-c41d00ee-c939-42ab-b438-9e2a95a18b39 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1731 microversion: 2.20 time: 0.189198 Oct 26 11:27:36.266137 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 456/900] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:36 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:36.972135 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-0765204b-105b-4492-83ca-cf94925eea31 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:36.972802 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-0765204b-105b-4492-83ca-cf94925eea31 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:36.975669 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_api:SELECT=42 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:27:36.987207 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0765204b-105b-4492-83ca-cf94925eea31 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:36.987716 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0765204b-105b-4492-83ca-cf94925eea31 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:36.988157 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0765204b-105b-4492-83ca-cf94925eea31 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:36.988885 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0765204b-105b-4492-83ca-cf94925eea31 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:36.989890 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0765204b-105b-4492-83ca-cf94925eea31 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:36.990330 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0765204b-105b-4492-83ca-cf94925eea31 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:37.215151 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-0765204b-105b-4492-83ca-cf94925eea31 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:37.228384 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-0765204b-105b-4492-83ca-cf94925eea31 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2" status: 200 len: 1267 microversion: 2.1 time: 0.260100 Oct 26 11:27:37.230749 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 445/901] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:27:36 2022] GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 => generated 1267 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:27:37.293125 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-a255fdd9-409f-49e4-9cdd-25ad49ad8985 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:37.293791 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-a255fdd9-409f-49e4-9cdd-25ad49ad8985 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:37.296598 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell0:SELECT=8 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:27:37.309006 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a255fdd9-409f-49e4-9cdd-25ad49ad8985 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:37.311244 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a255fdd9-409f-49e4-9cdd-25ad49ad8985 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:37.311705 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a255fdd9-409f-49e4-9cdd-25ad49ad8985 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:37.327249 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a255fdd9-409f-49e4-9cdd-25ad49ad8985 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:37.327761 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a255fdd9-409f-49e4-9cdd-25ad49ad8985 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:37.328205 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a255fdd9-409f-49e4-9cdd-25ad49ad8985 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:37.522334 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-a255fdd9-409f-49e4-9cdd-25ad49ad8985 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:37.531597 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-a255fdd9-409f-49e4-9cdd-25ad49ad8985 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:37.533492 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-a255fdd9-409f-49e4-9cdd-25ad49ad8985 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:37.538415 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-a255fdd9-409f-49e4-9cdd-25ad49ad8985 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1731 microversion: 2.20 time: 0.246069 Oct 26 11:27:37.539199 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 457/902] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:37 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1731 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:38.254764 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-63c9997e-0050-4f84-9dfa-69d5708575dd tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:38.256111 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-63c9997e-0050-4f84-9dfa-69d5708575dd tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:38.268885 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-63c9997e-0050-4f84-9dfa-69d5708575dd tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:38.269900 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-63c9997e-0050-4f84-9dfa-69d5708575dd tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:38.272523 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-63c9997e-0050-4f84-9dfa-69d5708575dd tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:38.273266 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-63c9997e-0050-4f84-9dfa-69d5708575dd tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:38.273910 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-63c9997e-0050-4f84-9dfa-69d5708575dd tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:38.276202 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-63c9997e-0050-4f84-9dfa-69d5708575dd tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:38.455380 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-63c9997e-0050-4f84-9dfa-69d5708575dd tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:38.476000 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-63c9997e-0050-4f84-9dfa-69d5708575dd tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2" status: 200 len: 1267 microversion: 2.1 time: 0.226303 Oct 26 11:27:38.476884 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 446/903] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:27:38 2022] GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 => generated 1267 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:27:38.560271 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-7d6e835d-4fd8-4eeb-86e5-d594c7e7b82a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:38.561735 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-7d6e835d-4fd8-4eeb-86e5-d594c7e7b82a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:38.569023 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7d6e835d-4fd8-4eeb-86e5-d594c7e7b82a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:38.574871 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7d6e835d-4fd8-4eeb-86e5-d594c7e7b82a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:38.576085 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7d6e835d-4fd8-4eeb-86e5-d594c7e7b82a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:38.577098 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7d6e835d-4fd8-4eeb-86e5-d594c7e7b82a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:38.581490 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7d6e835d-4fd8-4eeb-86e5-d594c7e7b82a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:38.582170 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7d6e835d-4fd8-4eeb-86e5-d594c7e7b82a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:38.810865 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-7d6e835d-4fd8-4eeb-86e5-d594c7e7b82a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:38.828236 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-7d6e835d-4fd8-4eeb-86e5-d594c7e7b82a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:38.830037 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-7d6e835d-4fd8-4eeb-86e5-d594c7e7b82a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:38.831308 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-7d6e835d-4fd8-4eeb-86e5-d594c7e7b82a tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1731 microversion: 2.20 time: 0.275270 Oct 26 11:27:38.831929 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 458/904] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:38 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1731 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:39.499915 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-bf4eb5ff-de9e-4200-bf06-562fd21c3628 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:39.500668 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-bf4eb5ff-de9e-4200-bf06-562fd21c3628 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:39.512007 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bf4eb5ff-de9e-4200-bf06-562fd21c3628 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:39.512507 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bf4eb5ff-de9e-4200-bf06-562fd21c3628 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:39.513162 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bf4eb5ff-de9e-4200-bf06-562fd21c3628 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:39.514051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bf4eb5ff-de9e-4200-bf06-562fd21c3628 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:39.514578 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bf4eb5ff-de9e-4200-bf06-562fd21c3628 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:39.515043 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bf4eb5ff-de9e-4200-bf06-562fd21c3628 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:39.781087 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-bf4eb5ff-de9e-4200-bf06-562fd21c3628 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:39.783825 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=8,nova_cell1:INSERT=4 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:27:39.793463 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-bf4eb5ff-de9e-4200-bf06-562fd21c3628 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2" status: 200 len: 1267 microversion: 2.1 time: 0.297573 Oct 26 11:27:39.812060 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 447/905] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:27:39 2022] GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 => generated 1267 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:27:39.857668 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-a103b4e5-6d49-4875-ad36-1cd05f3ee6fa tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:39.858296 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-a103b4e5-6d49-4875-ad36-1cd05f3ee6fa tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:39.868941 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a103b4e5-6d49-4875-ad36-1cd05f3ee6fa tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:39.869446 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a103b4e5-6d49-4875-ad36-1cd05f3ee6fa tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:39.871946 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a103b4e5-6d49-4875-ad36-1cd05f3ee6fa tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:39.872959 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a103b4e5-6d49-4875-ad36-1cd05f3ee6fa tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:39.879256 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a103b4e5-6d49-4875-ad36-1cd05f3ee6fa tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:39.880523 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a103b4e5-6d49-4875-ad36-1cd05f3ee6fa tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:40.268573 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-a103b4e5-6d49-4875-ad36-1cd05f3ee6fa tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:40.299228 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-a103b4e5-6d49-4875-ad36-1cd05f3ee6fa tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:40.301674 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-a103b4e5-6d49-4875-ad36-1cd05f3ee6fa tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:40.303189 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-a103b4e5-6d49-4875-ad36-1cd05f3ee6fa tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1731 microversion: 2.20 time: 0.449645 Oct 26 11:27:40.304345 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 459/906] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:39 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1731 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:40.820242 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-77c93b12-5d1b-4727-8cf9-af3015edfd8a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:40.821680 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-77c93b12-5d1b-4727-8cf9-af3015edfd8a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:40.840371 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-77c93b12-5d1b-4727-8cf9-af3015edfd8a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:40.840869 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-77c93b12-5d1b-4727-8cf9-af3015edfd8a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:40.841306 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-77c93b12-5d1b-4727-8cf9-af3015edfd8a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:40.842011 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-77c93b12-5d1b-4727-8cf9-af3015edfd8a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:40.842465 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-77c93b12-5d1b-4727-8cf9-af3015edfd8a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:40.843021 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-77c93b12-5d1b-4727-8cf9-af3015edfd8a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:40.987321 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-77c93b12-5d1b-4727-8cf9-af3015edfd8a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:40.995256 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-77c93b12-5d1b-4727-8cf9-af3015edfd8a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2" status: 200 len: 1267 microversion: 2.1 time: 0.180360 Oct 26 11:27:40.996057 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 448/907] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:27:40 2022] GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:27:41.329112 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-ab5c718d-1bfa-47cd-be0e-cfef3f455f7f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:41.329668 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-ab5c718d-1bfa-47cd-be0e-cfef3f455f7f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:41.337827 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ab5c718d-1bfa-47cd-be0e-cfef3f455f7f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:41.338314 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ab5c718d-1bfa-47cd-be0e-cfef3f455f7f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:41.338747 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ab5c718d-1bfa-47cd-be0e-cfef3f455f7f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:41.339476 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ab5c718d-1bfa-47cd-be0e-cfef3f455f7f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:41.339927 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ab5c718d-1bfa-47cd-be0e-cfef3f455f7f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:41.340348 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ab5c718d-1bfa-47cd-be0e-cfef3f455f7f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:41.536839 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ab5c718d-1bfa-47cd-be0e-cfef3f455f7f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:41.547954 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ab5c718d-1bfa-47cd-be0e-cfef3f455f7f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:41.549649 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ab5c718d-1bfa-47cd-be0e-cfef3f455f7f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:41.550939 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-ab5c718d-1bfa-47cd-be0e-cfef3f455f7f tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1731 microversion: 2.20 time: 0.225867 Oct 26 11:27:41.551905 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 460/908] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:41 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1731 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:42.018872 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-48ddf7c9-474e-4fb7-8c31-e2a973bf6af4 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:42.021054 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-48ddf7c9-474e-4fb7-8c31-e2a973bf6af4 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:42.031424 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-48ddf7c9-474e-4fb7-8c31-e2a973bf6af4 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:42.032578 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-48ddf7c9-474e-4fb7-8c31-e2a973bf6af4 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:42.033866 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-48ddf7c9-474e-4fb7-8c31-e2a973bf6af4 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:42.035929 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-48ddf7c9-474e-4fb7-8c31-e2a973bf6af4 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:42.037289 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-48ddf7c9-474e-4fb7-8c31-e2a973bf6af4 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:42.037950 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-48ddf7c9-474e-4fb7-8c31-e2a973bf6af4 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:42.219024 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-48ddf7c9-474e-4fb7-8c31-e2a973bf6af4 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:42.228563 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-48ddf7c9-474e-4fb7-8c31-e2a973bf6af4 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2" status: 200 len: 1267 microversion: 2.1 time: 0.214849 Oct 26 11:27:42.255685 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 449/909] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:27:42 2022] GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 => generated 1267 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:27:42.576818 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-61dd9b4e-23cd-4ec9-8980-7e42bc833497 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:42.578005 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-61dd9b4e-23cd-4ec9-8980-7e42bc833497 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:42.585940 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-61dd9b4e-23cd-4ec9-8980-7e42bc833497 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:42.586613 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-61dd9b4e-23cd-4ec9-8980-7e42bc833497 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:42.587263 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-61dd9b4e-23cd-4ec9-8980-7e42bc833497 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:42.588210 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-61dd9b4e-23cd-4ec9-8980-7e42bc833497 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:42.588805 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-61dd9b4e-23cd-4ec9-8980-7e42bc833497 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:42.589309 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-61dd9b4e-23cd-4ec9-8980-7e42bc833497 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:42.734980 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-61dd9b4e-23cd-4ec9-8980-7e42bc833497 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:42.760893 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-61dd9b4e-23cd-4ec9-8980-7e42bc833497 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:42.762782 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-61dd9b4e-23cd-4ec9-8980-7e42bc833497 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:42.764834 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-61dd9b4e-23cd-4ec9-8980-7e42bc833497 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1731 microversion: 2.20 time: 0.192112 Oct 26 11:27:42.766002 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 461/910] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:42 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1731 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:43.261057 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-c29eba53-6a34-4816-8e74-52a06522e211 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:43.263260 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-c29eba53-6a34-4816-8e74-52a06522e211 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:43.275230 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c29eba53-6a34-4816-8e74-52a06522e211 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:43.275901 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c29eba53-6a34-4816-8e74-52a06522e211 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:43.276351 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c29eba53-6a34-4816-8e74-52a06522e211 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:43.277066 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c29eba53-6a34-4816-8e74-52a06522e211 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:43.279263 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c29eba53-6a34-4816-8e74-52a06522e211 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:43.282138 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c29eba53-6a34-4816-8e74-52a06522e211 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:43.480439 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-c29eba53-6a34-4816-8e74-52a06522e211 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:43.501264 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-c29eba53-6a34-4816-8e74-52a06522e211 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2" status: 200 len: 1267 microversion: 2.1 time: 0.245124 Oct 26 11:27:43.516865 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 450/911] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:27:43 2022] GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 => generated 1267 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:27:43.805962 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-9db97c82-9521-4e8c-96fe-3c387c0559bf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:43.807540 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-9db97c82-9521-4e8c-96fe-3c387c0559bf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:43.825895 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9db97c82-9521-4e8c-96fe-3c387c0559bf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:43.827236 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9db97c82-9521-4e8c-96fe-3c387c0559bf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:43.830162 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9db97c82-9521-4e8c-96fe-3c387c0559bf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:43.836254 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9db97c82-9521-4e8c-96fe-3c387c0559bf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:43.836982 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9db97c82-9521-4e8c-96fe-3c387c0559bf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:43.837579 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9db97c82-9521-4e8c-96fe-3c387c0559bf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:44.186184 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-9db97c82-9521-4e8c-96fe-3c387c0559bf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:44.199187 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-9db97c82-9521-4e8c-96fe-3c387c0559bf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:44.208634 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-9db97c82-9521-4e8c-96fe-3c387c0559bf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:44.210272 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-9db97c82-9521-4e8c-96fe-3c387c0559bf tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1731 microversion: 2.20 time: 0.418374 Oct 26 11:27:44.214792 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 462/912] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:43 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1731 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:44.529623 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-eba8e1eb-ff1b-4521-b030-279785dbf40f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:44.530477 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-eba8e1eb-ff1b-4521-b030-279785dbf40f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:44.537253 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eba8e1eb-ff1b-4521-b030-279785dbf40f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:44.537950 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eba8e1eb-ff1b-4521-b030-279785dbf40f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:44.538469 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eba8e1eb-ff1b-4521-b030-279785dbf40f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:44.539274 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eba8e1eb-ff1b-4521-b030-279785dbf40f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:44.539808 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eba8e1eb-ff1b-4521-b030-279785dbf40f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:44.540340 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eba8e1eb-ff1b-4521-b030-279785dbf40f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:44.687304 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-eba8e1eb-ff1b-4521-b030-279785dbf40f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:44.699963 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-eba8e1eb-ff1b-4521-b030-279785dbf40f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2" status: 200 len: 1267 microversion: 2.1 time: 0.174153 Oct 26 11:27:44.715820 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 451/913] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:27:44 2022] GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:27:45.245754 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-15c38e6e-a9d1-40fb-b7f9-9dee5f265f54 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:45.247344 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-15c38e6e-a9d1-40fb-b7f9-9dee5f265f54 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:45.255116 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-15c38e6e-a9d1-40fb-b7f9-9dee5f265f54 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:45.255899 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-15c38e6e-a9d1-40fb-b7f9-9dee5f265f54 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:45.256573 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-15c38e6e-a9d1-40fb-b7f9-9dee5f265f54 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:45.257544 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-15c38e6e-a9d1-40fb-b7f9-9dee5f265f54 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:45.259417 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-15c38e6e-a9d1-40fb-b7f9-9dee5f265f54 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:45.260133 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-15c38e6e-a9d1-40fb-b7f9-9dee5f265f54 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:45.586714 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-15c38e6e-a9d1-40fb-b7f9-9dee5f265f54 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:45.594844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-15c38e6e-a9d1-40fb-b7f9-9dee5f265f54 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:45.596325 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-15c38e6e-a9d1-40fb-b7f9-9dee5f265f54 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:45.597486 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-15c38e6e-a9d1-40fb-b7f9-9dee5f265f54 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1731 microversion: 2.20 time: 0.355820 Oct 26 11:27:45.598051 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 463/914] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:45 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1731 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:45.728184 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-2ea41bfb-4b6a-4298-8b91-20373bf2c935 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:45.729331 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-2ea41bfb-4b6a-4298-8b91-20373bf2c935 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:45.735836 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2ea41bfb-4b6a-4298-8b91-20373bf2c935 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:45.736328 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2ea41bfb-4b6a-4298-8b91-20373bf2c935 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:45.736763 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2ea41bfb-4b6a-4298-8b91-20373bf2c935 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:45.737469 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2ea41bfb-4b6a-4298-8b91-20373bf2c935 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:45.737919 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2ea41bfb-4b6a-4298-8b91-20373bf2c935 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:45.738339 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2ea41bfb-4b6a-4298-8b91-20373bf2c935 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:45.887028 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-2ea41bfb-4b6a-4298-8b91-20373bf2c935 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:45.894731 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-2ea41bfb-4b6a-4298-8b91-20373bf2c935 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2" status: 200 len: 1267 microversion: 2.1 time: 0.170468 Oct 26 11:27:45.896183 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 452/915] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:27:45 2022] GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:27:46.623750 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-83a7e98d-7753-4187-af2c-eec3320f6cfc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:46.625741 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-83a7e98d-7753-4187-af2c-eec3320f6cfc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:46.632711 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-83a7e98d-7753-4187-af2c-eec3320f6cfc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:46.633381 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-83a7e98d-7753-4187-af2c-eec3320f6cfc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:46.633989 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-83a7e98d-7753-4187-af2c-eec3320f6cfc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:46.634920 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-83a7e98d-7753-4187-af2c-eec3320f6cfc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:46.635518 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-83a7e98d-7753-4187-af2c-eec3320f6cfc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:46.636088 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-83a7e98d-7753-4187-af2c-eec3320f6cfc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:46.793115 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-83a7e98d-7753-4187-af2c-eec3320f6cfc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:46.802875 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-83a7e98d-7753-4187-af2c-eec3320f6cfc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:46.804340 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-83a7e98d-7753-4187-af2c-eec3320f6cfc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:46.805500 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-83a7e98d-7753-4187-af2c-eec3320f6cfc tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1731 microversion: 2.20 time: 0.185923 Oct 26 11:27:46.806050 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 464/916] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:46 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:46.919353 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-9f74620c-077b-447e-a73e-4e39fb9103b6 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:46.920592 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-9f74620c-077b-447e-a73e-4e39fb9103b6 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:46.934363 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9f74620c-077b-447e-a73e-4e39fb9103b6 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:46.935146 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9f74620c-077b-447e-a73e-4e39fb9103b6 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:46.935604 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9f74620c-077b-447e-a73e-4e39fb9103b6 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:46.936382 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9f74620c-077b-447e-a73e-4e39fb9103b6 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:46.937018 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9f74620c-077b-447e-a73e-4e39fb9103b6 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:46.937635 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9f74620c-077b-447e-a73e-4e39fb9103b6 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:47.103727 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-9f74620c-077b-447e-a73e-4e39fb9103b6 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:47.112156 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-9f74620c-077b-447e-a73e-4e39fb9103b6 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2" status: 200 len: 1267 microversion: 2.1 time: 0.196572 Oct 26 11:27:47.127028 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 453/917] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:27:46 2022] GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 => generated 1267 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:27:47.834199 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-4c01aab7-f8c9-4008-9453-7028830f31f9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:47.834937 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-4c01aab7-f8c9-4008-9453-7028830f31f9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:47.842283 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4c01aab7-f8c9-4008-9453-7028830f31f9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:47.843072 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4c01aab7-f8c9-4008-9453-7028830f31f9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:47.843511 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4c01aab7-f8c9-4008-9453-7028830f31f9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:47.844283 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4c01aab7-f8c9-4008-9453-7028830f31f9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:47.844818 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4c01aab7-f8c9-4008-9453-7028830f31f9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:47.845406 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4c01aab7-f8c9-4008-9453-7028830f31f9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:48.004141 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-4c01aab7-f8c9-4008-9453-7028830f31f9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:48.012581 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-4c01aab7-f8c9-4008-9453-7028830f31f9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:48.014059 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-4c01aab7-f8c9-4008-9453-7028830f31f9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:48.015281 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-4c01aab7-f8c9-4008-9453-7028830f31f9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1731 microversion: 2.20 time: 0.185318 Oct 26 11:27:48.015862 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 465/918] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:47 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1731 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:48.135966 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-63b3080a-b1b4-46e4-8716-b56a5a968d7f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:48.140899 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-63b3080a-b1b4-46e4-8716-b56a5a968d7f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:48.143034 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-63b3080a-b1b4-46e4-8716-b56a5a968d7f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:48.143526 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-63b3080a-b1b4-46e4-8716-b56a5a968d7f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:48.143966 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-63b3080a-b1b4-46e4-8716-b56a5a968d7f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:48.144673 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-63b3080a-b1b4-46e4-8716-b56a5a968d7f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:48.145127 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-63b3080a-b1b4-46e4-8716-b56a5a968d7f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:48.145610 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-63b3080a-b1b4-46e4-8716-b56a5a968d7f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:48.290488 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-63b3080a-b1b4-46e4-8716-b56a5a968d7f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:48.298643 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-63b3080a-b1b4-46e4-8716-b56a5a968d7f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2" status: 200 len: 1267 microversion: 2.1 time: 0.166450 Oct 26 11:27:48.311429 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 454/919] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:27:48 2022] GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:27:49.045829 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-d9e162ec-c257-40cd-ba4d-b1f8afa9a4f8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:49.047284 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-d9e162ec-c257-40cd-ba4d-b1f8afa9a4f8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:49.054425 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d9e162ec-c257-40cd-ba4d-b1f8afa9a4f8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:49.055341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d9e162ec-c257-40cd-ba4d-b1f8afa9a4f8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:49.055968 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d9e162ec-c257-40cd-ba4d-b1f8afa9a4f8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:49.056838 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d9e162ec-c257-40cd-ba4d-b1f8afa9a4f8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:49.057332 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d9e162ec-c257-40cd-ba4d-b1f8afa9a4f8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:49.057760 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d9e162ec-c257-40cd-ba4d-b1f8afa9a4f8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:49.247945 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-d9e162ec-c257-40cd-ba4d-b1f8afa9a4f8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:49.258438 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-d9e162ec-c257-40cd-ba4d-b1f8afa9a4f8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:49.260195 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-d9e162ec-c257-40cd-ba4d-b1f8afa9a4f8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:49.261730 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-d9e162ec-c257-40cd-ba4d-b1f8afa9a4f8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1731 microversion: 2.20 time: 0.220079 Oct 26 11:27:49.262661 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 466/920] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:49 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1731 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:49.323971 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-e85fae5a-db52-4cbd-881b-165dc52bbba0 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:49.325378 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-e85fae5a-db52-4cbd-881b-165dc52bbba0 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:49.332129 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e85fae5a-db52-4cbd-881b-165dc52bbba0 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:49.332821 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e85fae5a-db52-4cbd-881b-165dc52bbba0 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:49.333971 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e85fae5a-db52-4cbd-881b-165dc52bbba0 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:49.335038 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e85fae5a-db52-4cbd-881b-165dc52bbba0 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:49.335666 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e85fae5a-db52-4cbd-881b-165dc52bbba0 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:49.336272 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e85fae5a-db52-4cbd-881b-165dc52bbba0 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:49.516692 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-e85fae5a-db52-4cbd-881b-165dc52bbba0 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:49.527099 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-e85fae5a-db52-4cbd-881b-165dc52bbba0 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2" status: 200 len: 1267 microversion: 2.1 time: 0.207092 Oct 26 11:27:49.529013 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 455/921] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:27:49 2022] GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 => generated 1267 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:27:50.288626 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-f37c0d89-4235-4640-9f02-35a5b4b51240 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:50.289937 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-f37c0d89-4235-4640-9f02-35a5b4b51240 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:50.296840 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f37c0d89-4235-4640-9f02-35a5b4b51240 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:50.297803 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f37c0d89-4235-4640-9f02-35a5b4b51240 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:50.298908 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f37c0d89-4235-4640-9f02-35a5b4b51240 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:50.299861 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f37c0d89-4235-4640-9f02-35a5b4b51240 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:50.300539 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f37c0d89-4235-4640-9f02-35a5b4b51240 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:50.301185 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f37c0d89-4235-4640-9f02-35a5b4b51240 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:50.456075 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-f37c0d89-4235-4640-9f02-35a5b4b51240 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:50.467321 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-f37c0d89-4235-4640-9f02-35a5b4b51240 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:50.469239 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-f37c0d89-4235-4640-9f02-35a5b4b51240 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:50.470356 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-f37c0d89-4235-4640-9f02-35a5b4b51240 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1731 microversion: 2.20 time: 0.186669 Oct 26 11:27:50.471620 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 467/922] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:50 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 26 11:27:50.552489 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-9cb74fb4-758e-4c8e-9ac0-fd72a2228126 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:50.554094 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-9cb74fb4-758e-4c8e-9ac0-fd72a2228126 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:50.566759 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9cb74fb4-758e-4c8e-9ac0-fd72a2228126 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:50.569810 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9cb74fb4-758e-4c8e-9ac0-fd72a2228126 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:50.570453 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9cb74fb4-758e-4c8e-9ac0-fd72a2228126 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:50.572618 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9cb74fb4-758e-4c8e-9ac0-fd72a2228126 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:50.573091 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9cb74fb4-758e-4c8e-9ac0-fd72a2228126 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:50.574348 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9cb74fb4-758e-4c8e-9ac0-fd72a2228126 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:50.773979 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-9cb74fb4-758e-4c8e-9ac0-fd72a2228126 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:50.784181 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-9cb74fb4-758e-4c8e-9ac0-fd72a2228126 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2" status: 200 len: 1267 microversion: 2.1 time: 0.234851 Oct 26 11:27:50.784181 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 456/923] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:27:50 2022] GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 => generated 1267 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:27:51.499100 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-cf9b7671-98b1-4563-a0e5-8682c7a56850 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:51.499809 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-cf9b7671-98b1-4563-a0e5-8682c7a56850 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:51.506557 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-cf9b7671-98b1-4563-a0e5-8682c7a56850 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:51.507093 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-cf9b7671-98b1-4563-a0e5-8682c7a56850 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:51.507530 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-cf9b7671-98b1-4563-a0e5-8682c7a56850 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:51.508258 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-cf9b7671-98b1-4563-a0e5-8682c7a56850 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:51.508713 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-cf9b7671-98b1-4563-a0e5-8682c7a56850 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:51.509138 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-cf9b7671-98b1-4563-a0e5-8682c7a56850 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:51.650296 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-cf9b7671-98b1-4563-a0e5-8682c7a56850 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:51.658980 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-cf9b7671-98b1-4563-a0e5-8682c7a56850 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:51.660670 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-cf9b7671-98b1-4563-a0e5-8682c7a56850 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:51.662130 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-cf9b7671-98b1-4563-a0e5-8682c7a56850 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1731 microversion: 2.20 time: 0.167171 Oct 26 11:27:51.662693 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 468/924] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:51 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:51.810271 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-2cc39ae4-9b44-42ce-b561-a2091384d61b tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:51.811531 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-2cc39ae4-9b44-42ce-b561-a2091384d61b tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:51.818643 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2cc39ae4-9b44-42ce-b561-a2091384d61b tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:51.819194 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2cc39ae4-9b44-42ce-b561-a2091384d61b tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:51.819633 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2cc39ae4-9b44-42ce-b561-a2091384d61b tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:51.820336 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2cc39ae4-9b44-42ce-b561-a2091384d61b tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:51.820791 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2cc39ae4-9b44-42ce-b561-a2091384d61b tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:51.821244 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2cc39ae4-9b44-42ce-b561-a2091384d61b tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:51.988063 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-2cc39ae4-9b44-42ce-b561-a2091384d61b tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:51.996659 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-2cc39ae4-9b44-42ce-b561-a2091384d61b tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2" status: 200 len: 1267 microversion: 2.1 time: 0.190622 Oct 26 11:27:51.997243 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 457/925] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:27:51 2022] GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:27:52.552212 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-312e6636-1e3c-44cc-883b-e0d972a833a8 req-99fe0316-d365-4af0-bd25-4bfe1af2f4c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aba99081-fcee-4a22-80e9-7c08f92a03d2", "name": "network-vif-plugged", "status": "completed", "tag": "5b41cdbe-3c75-436a-bb3e-d85764fc830a"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:27:52.572931 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-312e6636-1e3c-44cc-883b-e0d972a833a8 req-99fe0316-d365-4af0-bd25-4bfe1af2f4c3 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:52.573417 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-312e6636-1e3c-44cc-883b-e0d972a833a8 req-99fe0316-d365-4af0-bd25-4bfe1af2f4c3 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:52.573843 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-312e6636-1e3c-44cc-883b-e0d972a833a8 req-99fe0316-d365-4af0-bd25-4bfe1af2f4c3 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:52.594790 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-312e6636-1e3c-44cc-883b-e0d972a833a8 req-99fe0316-d365-4af0-bd25-4bfe1af2f4c3 service nova] Creating event network-vif-plugged:5b41cdbe-3c75-436a-bb3e-d85764fc830a for instance aba99081-fcee-4a22-80e9-7c08f92a03d2 on hv-cinder-81558 Oct 26 11:27:52.604674 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-312e6636-1e3c-44cc-883b-e0d972a833a8 req-99fe0316-d365-4af0-bd25-4bfe1af2f4c3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055625 Oct 26 11:27:52.605670 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 469/926] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:27:52.690090 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-92d304ce-f63b-4079-9619-acc2e409c526 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:52.691163 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-92d304ce-f63b-4079-9619-acc2e409c526 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:52.712265 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-92d304ce-f63b-4079-9619-acc2e409c526 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:52.714723 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-92d304ce-f63b-4079-9619-acc2e409c526 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:52.715470 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-92d304ce-f63b-4079-9619-acc2e409c526 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:52.719949 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-92d304ce-f63b-4079-9619-acc2e409c526 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:52.730005 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-92d304ce-f63b-4079-9619-acc2e409c526 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:52.737063 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-92d304ce-f63b-4079-9619-acc2e409c526 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:52.931299 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-92d304ce-f63b-4079-9619-acc2e409c526 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:52.944050 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-92d304ce-f63b-4079-9619-acc2e409c526 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:52.948435 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-92d304ce-f63b-4079-9619-acc2e409c526 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:52.949691 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-92d304ce-f63b-4079-9619-acc2e409c526 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1731 microversion: 2.20 time: 0.265720 Oct 26 11:27:52.952708 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 458/927] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:52 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1731 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:53.037586 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-0e2d4576-6d59-421e-8d88-f8bc1dc53acc tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:53.043382 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-0e2d4576-6d59-421e-8d88-f8bc1dc53acc tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:53.057066 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0e2d4576-6d59-421e-8d88-f8bc1dc53acc tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:53.061258 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0e2d4576-6d59-421e-8d88-f8bc1dc53acc tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:53.061258 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0e2d4576-6d59-421e-8d88-f8bc1dc53acc tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:53.061258 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0e2d4576-6d59-421e-8d88-f8bc1dc53acc tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:53.061258 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0e2d4576-6d59-421e-8d88-f8bc1dc53acc tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:53.061619 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0e2d4576-6d59-421e-8d88-f8bc1dc53acc tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:53.294201 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-0e2d4576-6d59-421e-8d88-f8bc1dc53acc tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:53.304904 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-0e2d4576-6d59-421e-8d88-f8bc1dc53acc tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2" status: 200 len: 1267 microversion: 2.1 time: 0.287272 Oct 26 11:27:53.305853 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 470/928] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:27:53 2022] GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 => generated 1267 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:27:53.979780 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-70f1fdf8-506d-4dae-af4d-0ef2e683038c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:53.980873 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-70f1fdf8-506d-4dae-af4d-0ef2e683038c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:53.989769 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-70f1fdf8-506d-4dae-af4d-0ef2e683038c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:53.990537 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-70f1fdf8-506d-4dae-af4d-0ef2e683038c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:53.991282 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-70f1fdf8-506d-4dae-af4d-0ef2e683038c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:53.994913 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-70f1fdf8-506d-4dae-af4d-0ef2e683038c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:53.995685 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-70f1fdf8-506d-4dae-af4d-0ef2e683038c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:53.997078 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-70f1fdf8-506d-4dae-af4d-0ef2e683038c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:54.188830 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-70f1fdf8-506d-4dae-af4d-0ef2e683038c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:54.198168 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-70f1fdf8-506d-4dae-af4d-0ef2e683038c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:54.200046 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-70f1fdf8-506d-4dae-af4d-0ef2e683038c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:54.201301 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-70f1fdf8-506d-4dae-af4d-0ef2e683038c tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1731 microversion: 2.20 time: 0.225754 Oct 26 11:27:54.201931 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 459/929] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:53 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1731 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:54.329211 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-20908edb-be90-48e8-a566-f8c72d71b971 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:54.330378 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-20908edb-be90-48e8-a566-f8c72d71b971 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:54.341034 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-20908edb-be90-48e8-a566-f8c72d71b971 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:54.341704 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-20908edb-be90-48e8-a566-f8c72d71b971 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:54.342328 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-20908edb-be90-48e8-a566-f8c72d71b971 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:54.343082 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-20908edb-be90-48e8-a566-f8c72d71b971 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:54.343539 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-20908edb-be90-48e8-a566-f8c72d71b971 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:54.343971 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-20908edb-be90-48e8-a566-f8c72d71b971 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:54.373067 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=100 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:27:54.509644 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-20908edb-be90-48e8-a566-f8c72d71b971 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:54.518173 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-20908edb-be90-48e8-a566-f8c72d71b971 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2" status: 200 len: 1267 microversion: 2.1 time: 0.193336 Oct 26 11:27:54.521021 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 471/930] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:27:54 2022] GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:27:54.624339 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-86f0436b-25bd-4266-8b95-3674c48f0711 req-25e8635b-736d-4989-8e12-2ab5c7e3c3c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "032aed92-2b14-4791-8612-a0261e6d77fd", "name": "network-vif-plugged", "status": "completed", "tag": "d48eea34-8900-4e01-bcd5-3b4a5f2f3dd1"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:27:54.635077 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-86f0436b-25bd-4266-8b95-3674c48f0711 req-25e8635b-736d-4989-8e12-2ab5c7e3c3c6 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:54.635549 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-86f0436b-25bd-4266-8b95-3674c48f0711 req-25e8635b-736d-4989-8e12-2ab5c7e3c3c6 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:54.635964 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-86f0436b-25bd-4266-8b95-3674c48f0711 req-25e8635b-736d-4989-8e12-2ab5c7e3c3c6 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:54.651606 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-86f0436b-25bd-4266-8b95-3674c48f0711 req-25e8635b-736d-4989-8e12-2ab5c7e3c3c6 service nova] Creating event network-vif-plugged:d48eea34-8900-4e01-bcd5-3b4a5f2f3dd1 for instance 032aed92-2b14-4791-8612-a0261e6d77fd on hv-cinder-81558 Oct 26 11:27:54.658059 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-86f0436b-25bd-4266-8b95-3674c48f0711 req-25e8635b-736d-4989-8e12-2ab5c7e3c3c6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038523 Oct 26 11:27:54.658979 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 460/931] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:27:55.229669 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-55837b91-7f16-4665-b836-e67f0a96e3b8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:55.230374 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-55837b91-7f16-4665-b836-e67f0a96e3b8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:55.236684 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-55837b91-7f16-4665-b836-e67f0a96e3b8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:55.237172 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-55837b91-7f16-4665-b836-e67f0a96e3b8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:55.237612 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-55837b91-7f16-4665-b836-e67f0a96e3b8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:55.238394 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-55837b91-7f16-4665-b836-e67f0a96e3b8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:55.238924 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-55837b91-7f16-4665-b836-e67f0a96e3b8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:55.239357 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-55837b91-7f16-4665-b836-e67f0a96e3b8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:55.544225 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-d0979488-0a97-4f86-86c3-0512d7a1a4b0 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:55.544964 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-d0979488-0a97-4f86-86c3-0512d7a1a4b0 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:55.551380 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d0979488-0a97-4f86-86c3-0512d7a1a4b0 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:55.552399 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d0979488-0a97-4f86-86c3-0512d7a1a4b0 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:55.552850 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d0979488-0a97-4f86-86c3-0512d7a1a4b0 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:55.553590 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d0979488-0a97-4f86-86c3-0512d7a1a4b0 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:55.554012 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d0979488-0a97-4f86-86c3-0512d7a1a4b0 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:55.554439 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d0979488-0a97-4f86-86c3-0512d7a1a4b0 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:55.567069 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-55837b91-7f16-4665-b836-e67f0a96e3b8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:55.576512 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-55837b91-7f16-4665-b836-e67f0a96e3b8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:55.578014 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-55837b91-7f16-4665-b836-e67f0a96e3b8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:55.579309 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-55837b91-7f16-4665-b836-e67f0a96e3b8 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1731 microversion: 2.20 time: 0.354573 Oct 26 11:27:55.580115 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 472/932] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:55 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1731 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:55.703664 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-d0979488-0a97-4f86-86c3-0512d7a1a4b0 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:55.712830 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-d0979488-0a97-4f86-86c3-0512d7a1a4b0 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2" status: 200 len: 1454 microversion: 2.1 time: 0.173405 Oct 26 11:27:55.723244 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 461/933] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:27:55 2022] GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 => generated 1454 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:27:55.737241 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-5d5bbb54-0611-4b57-bf22-a433aa2f338a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:55.738108 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-5d5bbb54-0611-4b57-bf22-a433aa2f338a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:55.745153 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5d5bbb54-0611-4b57-bf22-a433aa2f338a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:55.746220 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5d5bbb54-0611-4b57-bf22-a433aa2f338a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:55.746812 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5d5bbb54-0611-4b57-bf22-a433aa2f338a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:55.747924 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5d5bbb54-0611-4b57-bf22-a433aa2f338a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:55.748542 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5d5bbb54-0611-4b57-bf22-a433aa2f338a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:55.749156 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5d5bbb54-0611-4b57-bf22-a433aa2f338a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:55.893733 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-5d5bbb54-0611-4b57-bf22-a433aa2f338a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:55.901943 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-5d5bbb54-0611-4b57-bf22-a433aa2f338a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2" status: 200 len: 1454 microversion: 2.1 time: 0.168519 Oct 26 11:27:55.902747 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 473/934] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:27:55 2022] GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 => generated 1454 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:27:56.606456 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-6dba1dcf-cfb4-4f2f-a931-918aa527f0e4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:56.607206 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-6dba1dcf-cfb4-4f2f-a931-918aa527f0e4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:56.615373 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6dba1dcf-cfb4-4f2f-a931-918aa527f0e4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:56.620717 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6dba1dcf-cfb4-4f2f-a931-918aa527f0e4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:56.620717 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6dba1dcf-cfb4-4f2f-a931-918aa527f0e4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:56.620717 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6dba1dcf-cfb4-4f2f-a931-918aa527f0e4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:56.620717 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6dba1dcf-cfb4-4f2f-a931-918aa527f0e4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:56.621116 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6dba1dcf-cfb4-4f2f-a931-918aa527f0e4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:56.791923 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-6dba1dcf-cfb4-4f2f-a931-918aa527f0e4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:56.800753 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-6dba1dcf-cfb4-4f2f-a931-918aa527f0e4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:56.802948 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-6dba1dcf-cfb4-4f2f-a931-918aa527f0e4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:56.807455 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-6dba1dcf-cfb4-4f2f-a931-918aa527f0e4 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1731 microversion: 2.20 time: 0.202665 Oct 26 11:27:56.808446 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 462/935] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:56 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1731 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:57.836453 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-036ec4c1-f6d6-44d6-922f-4d94dd2a6428 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:57.837231 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-036ec4c1-f6d6-44d6-922f-4d94dd2a6428 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:57.844513 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-036ec4c1-f6d6-44d6-922f-4d94dd2a6428 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:57.845286 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-036ec4c1-f6d6-44d6-922f-4d94dd2a6428 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:57.845909 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-036ec4c1-f6d6-44d6-922f-4d94dd2a6428 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:57.846809 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-036ec4c1-f6d6-44d6-922f-4d94dd2a6428 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:57.847292 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-036ec4c1-f6d6-44d6-922f-4d94dd2a6428 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:57.847919 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-036ec4c1-f6d6-44d6-922f-4d94dd2a6428 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:58.151984 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-036ec4c1-f6d6-44d6-922f-4d94dd2a6428 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:58.164118 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-036ec4c1-f6d6-44d6-922f-4d94dd2a6428 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:58.165485 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-036ec4c1-f6d6-44d6-922f-4d94dd2a6428 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:58.167204 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-036ec4c1-f6d6-44d6-922f-4d94dd2a6428 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1731 microversion: 2.20 time: 0.334181 Oct 26 11:27:58.174941 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 474/936] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:57 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1731 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:58.611141 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-b9d3a0d4-2044-4b2b-be0d-f945b128c7d1 req-3dabf2df-ec49-46aa-a7d8-cabc196b280f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aba99081-fcee-4a22-80e9-7c08f92a03d2", "tag": "5b41cdbe-3c75-436a-bb3e-d85764fc830a"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:27:58.620637 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-b9d3a0d4-2044-4b2b-be0d-f945b128c7d1 req-3dabf2df-ec49-46aa-a7d8-cabc196b280f service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:58.622186 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-b9d3a0d4-2044-4b2b-be0d-f945b128c7d1 req-3dabf2df-ec49-46aa-a7d8-cabc196b280f service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:58.622186 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-b9d3a0d4-2044-4b2b-be0d-f945b128c7d1 req-3dabf2df-ec49-46aa-a7d8-cabc196b280f service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:58.632958 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-b9d3a0d4-2044-4b2b-be0d-f945b128c7d1 req-3dabf2df-ec49-46aa-a7d8-cabc196b280f service nova] Creating event network-changed:5b41cdbe-3c75-436a-bb3e-d85764fc830a for instance aba99081-fcee-4a22-80e9-7c08f92a03d2 on hv-cinder-81558 Oct 26 11:27:58.637826 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-b9d3a0d4-2044-4b2b-be0d-f945b128c7d1 req-3dabf2df-ec49-46aa-a7d8-cabc196b280f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030335 Oct 26 11:27:58.638768 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 463/937] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:27:59.202864 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-df30cfbc-7c2d-41f2-9953-9a0b77786317 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:27:59.206032 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-df30cfbc-7c2d-41f2-9953-9a0b77786317 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:27:59.219844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-df30cfbc-7c2d-41f2-9953-9a0b77786317 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:59.220343 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-df30cfbc-7c2d-41f2-9953-9a0b77786317 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:59.220783 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-df30cfbc-7c2d-41f2-9953-9a0b77786317 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:59.221689 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-df30cfbc-7c2d-41f2-9953-9a0b77786317 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:27:59.222154 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-df30cfbc-7c2d-41f2-9953-9a0b77786317 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:27:59.222581 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-df30cfbc-7c2d-41f2-9953-9a0b77786317 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:27:59.402404 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-df30cfbc-7c2d-41f2-9953-9a0b77786317 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:59.411810 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-df30cfbc-7c2d-41f2-9953-9a0b77786317 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:59.416186 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-df30cfbc-7c2d-41f2-9953-9a0b77786317 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:27:59.418158 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-df30cfbc-7c2d-41f2-9953-9a0b77786317 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1731 microversion: 2.20 time: 0.220043 Oct 26 11:27:59.419593 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 475/938] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:27:59 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1731 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:27:59.957312 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-62f33ee2-e7ed-43d6-9372-8a44251c1e19 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Action: 'create', calling method: .version_select at 0x7f6b93740820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1874612399", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASHw/j9+vUzHQgeXa1NSD8Z6j1IR0JaA2rl191r8WH7W7EK1w2eYpHKUpiEhViMvwVlRHTyst/rYg4k7FWgXIL8p0Xc4ByclXQBo5VhZlM4RtPr0nyPhiTpHtzsMoEZkw=="}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:27:59.972763 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.quota [None req-62f33ee2-e7ed-43d6-9372-8a44251c1e19 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Getting quotas for project a975701f3c69481b874e106eb5d4edcd. Resources: {'key_pairs'} {{(pid=119305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:27:59.977297 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.quota [None req-62f33ee2-e7ed-43d6-9372-8a44251c1e19 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Getting quotas for user e7088cf9374c4e7d8e60c34a782fb42f and project a975701f3c69481b874e106eb5d4edcd. Resources: {'key_pairs'} {{(pid=119305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:28:00.052703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-62f33ee2-e7ed-43d6-9372-8a44251c1e19 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.100066 Oct 26 11:28:00.053331 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 464/939] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Oct 26 11:27:59 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:28:00.102969 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-a9e33bb1-357d-4c68-8102-606b9093f0a0 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1836922828", "imageRef": "131df8a4-75dc-4520-bb85-72d42ec10150", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1874612399", "networks": [{"uuid": "4664d3b1-d59c-4b37-b8b7-6ffd74b2e728"}]}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:28:00.156006 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.network.neutron [None req-a9e33bb1-357d-4c68-8102-606b9093f0a0 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] validate_networks() for [('4664d3b1-d59c-4b37-b8b7-6ffd74b2e728', None, None, None, None, None)] {{(pid=119306) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 11:28:00.445205 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-53152bb6-797b-4655-8ca9-1177d5f9dda6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:00.445954 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-53152bb6-797b-4655-8ca9-1177d5f9dda6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:00.452235 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-53152bb6-797b-4655-8ca9-1177d5f9dda6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:00.452722 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-53152bb6-797b-4655-8ca9-1177d5f9dda6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:00.453168 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-53152bb6-797b-4655-8ca9-1177d5f9dda6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:00.453866 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-53152bb6-797b-4655-8ca9-1177d5f9dda6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:00.454328 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-53152bb6-797b-4655-8ca9-1177d5f9dda6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:00.454754 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-53152bb6-797b-4655-8ca9-1177d5f9dda6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:00.513701 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-a9e33bb1-357d-4c68-8102-606b9093f0a0 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Flavor limits 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 11:28:00.514146 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-a9e33bb1-357d-4c68-8102-606b9093f0a0 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Image limits 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 11:28:00.514601 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-a9e33bb1-357d-4c68-8102-606b9093f0a0 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Flavor pref 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 11:28:00.515044 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-a9e33bb1-357d-4c68-8102-606b9093f0a0 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Image pref 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 11:28:00.515457 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-a9e33bb1-357d-4c68-8102-606b9093f0a0 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 11:28:00.524634 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a9e33bb1-357d-4c68-8102-606b9093f0a0 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:00.525123 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a9e33bb1-357d-4c68-8102-606b9093f0a0 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:00.525563 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a9e33bb1-357d-4c68-8102-606b9093f0a0 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:00.526293 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a9e33bb1-357d-4c68-8102-606b9093f0a0 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:00.526751 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a9e33bb1-357d-4c68-8102-606b9093f0a0 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:00.527204 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a9e33bb1-357d-4c68-8102-606b9093f0a0 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:00.544163 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-a9e33bb1-357d-4c68-8102-606b9093f0a0 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Getting quotas for project a975701f3c69481b874e106eb5d4edcd. Resources: {'cores', 'instances', 'ram'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:28:00.548647 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-a9e33bb1-357d-4c68-8102-606b9093f0a0 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Getting quotas for user e7088cf9374c4e7d8e60c34a782fb42f and project a975701f3c69481b874e106eb5d4edcd. Resources: {'cores', 'instances', 'ram'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:28:00.560223 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-a9e33bb1-357d-4c68-8102-606b9093f0a0 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Going to run 1 instances... {{(pid=119306) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 11:28:00.562489 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-a9e33bb1-357d-4c68-8102-606b9093f0a0 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='131df8a4-75dc-4520-bb85-72d42ec10150',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119306) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 11:28:00.699619 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-53152bb6-797b-4655-8ca9-1177d5f9dda6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:00.707678 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-53152bb6-797b-4655-8ca9-1177d5f9dda6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:00.709119 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-53152bb6-797b-4655-8ca9-1177d5f9dda6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:00.710271 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-53152bb6-797b-4655-8ca9-1177d5f9dda6 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1718 microversion: 2.20 time: 0.269679 Oct 26 11:28:00.710839 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 465/940] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:28:00 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1718 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:28:00.722193 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-a9e33bb1-357d-4c68-8102-606b9093f0a0 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.623065 Oct 26 11:28:00.722883 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 476/941] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Oct 26 11:28:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 11:28:00.734462 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-1b360891-53de-4d5e-8c6c-7acbb10d4d48 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:00.735122 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-1b360891-53de-4d5e-8c6c-7acbb10d4d48 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:00.796384 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-1b360891-53de-4d5e-8c6c-7acbb10d4d48 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:00.804139 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-1b360891-53de-4d5e-8c6c-7acbb10d4d48 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1259 microversion: 2.1 time: 0.073960 Oct 26 11:28:00.804741 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 466/942] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:00 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1259 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:28:01.827781 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-531f32cc-05c6-4e48-b230-155300fd26b4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:01.828562 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-531f32cc-05c6-4e48-b230-155300fd26b4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:01.835305 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-531f32cc-05c6-4e48-b230-155300fd26b4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:01.835845 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-531f32cc-05c6-4e48-b230-155300fd26b4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:01.836281 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-531f32cc-05c6-4e48-b230-155300fd26b4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:01.836982 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-531f32cc-05c6-4e48-b230-155300fd26b4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:01.837436 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-531f32cc-05c6-4e48-b230-155300fd26b4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:01.837906 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-531f32cc-05c6-4e48-b230-155300fd26b4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:01.899190 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-531f32cc-05c6-4e48-b230-155300fd26b4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:01.906971 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-531f32cc-05c6-4e48-b230-155300fd26b4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1263 microversion: 2.1 time: 0.083848 Oct 26 11:28:01.907626 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 477/943] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:01 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1263 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:28:02.929511 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-0d251afb-15a1-44b2-bfef-127ac887068d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:02.930252 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-0d251afb-15a1-44b2-bfef-127ac887068d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:02.936770 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0d251afb-15a1-44b2-bfef-127ac887068d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:02.937258 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0d251afb-15a1-44b2-bfef-127ac887068d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:02.937695 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0d251afb-15a1-44b2-bfef-127ac887068d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:02.938393 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0d251afb-15a1-44b2-bfef-127ac887068d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:02.938866 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0d251afb-15a1-44b2-bfef-127ac887068d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:02.939294 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0d251afb-15a1-44b2-bfef-127ac887068d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:03.002451 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-0d251afb-15a1-44b2-bfef-127ac887068d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:03.004756 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=100 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:28:03.010802 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-0d251afb-15a1-44b2-bfef-127ac887068d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1311 microversion: 2.1 time: 0.085150 Oct 26 11:28:03.011400 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 467/944] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:02 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1311 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:28:04.035254 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-f485f60a-e587-4150-aec2-d2d75b993e55 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:04.036530 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-f485f60a-e587-4150-aec2-d2d75b993e55 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:04.044951 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f485f60a-e587-4150-aec2-d2d75b993e55 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:04.045726 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f485f60a-e587-4150-aec2-d2d75b993e55 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:04.046187 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f485f60a-e587-4150-aec2-d2d75b993e55 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:04.047129 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f485f60a-e587-4150-aec2-d2d75b993e55 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:04.047819 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f485f60a-e587-4150-aec2-d2d75b993e55 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:04.048581 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f485f60a-e587-4150-aec2-d2d75b993e55 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:04.275394 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-f485f60a-e587-4150-aec2-d2d75b993e55 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:04.283129 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-f485f60a-e587-4150-aec2-d2d75b993e55 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1359 microversion: 2.1 time: 0.251964 Oct 26 11:28:04.283806 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 478/945] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:04 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1359 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:28:05.306081 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-eb899b03-1258-46eb-a80d-24589f0bafca tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:05.307117 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-eb899b03-1258-46eb-a80d-24589f0bafca tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:05.314720 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eb899b03-1258-46eb-a80d-24589f0bafca tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:05.315248 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eb899b03-1258-46eb-a80d-24589f0bafca tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:05.315694 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eb899b03-1258-46eb-a80d-24589f0bafca tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:05.316408 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eb899b03-1258-46eb-a80d-24589f0bafca tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:05.316909 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eb899b03-1258-46eb-a80d-24589f0bafca tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:05.317338 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eb899b03-1258-46eb-a80d-24589f0bafca tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:05.449696 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-eb899b03-1258-46eb-a80d-24589f0bafca tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:05.457573 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-eb899b03-1258-46eb-a80d-24589f0bafca tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1359 microversion: 2.1 time: 0.155685 Oct 26 11:28:05.458155 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 468/946] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:05 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:28:06.481764 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-4702c812-39be-49f7-878d-29a62adebc17 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:06.483298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-4702c812-39be-49f7-878d-29a62adebc17 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:06.490549 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4702c812-39be-49f7-878d-29a62adebc17 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:06.491152 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4702c812-39be-49f7-878d-29a62adebc17 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:06.491593 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4702c812-39be-49f7-878d-29a62adebc17 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:06.492297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4702c812-39be-49f7-878d-29a62adebc17 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:06.492869 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4702c812-39be-49f7-878d-29a62adebc17 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:06.493513 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-4702c812-39be-49f7-878d-29a62adebc17 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:06.627923 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-4702c812-39be-49f7-878d-29a62adebc17 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:06.636552 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-4702c812-39be-49f7-878d-29a62adebc17 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1359 microversion: 2.1 time: 0.159344 Oct 26 11:28:06.637198 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 479/947] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:06 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:28:07.660811 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-376efe8f-3a25-488c-8e0a-9a4db04c492b tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:07.660811 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-376efe8f-3a25-488c-8e0a-9a4db04c492b tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:07.662913 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:28:07.667582 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-376efe8f-3a25-488c-8e0a-9a4db04c492b tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:07.668064 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-376efe8f-3a25-488c-8e0a-9a4db04c492b tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:07.671589 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-376efe8f-3a25-488c-8e0a-9a4db04c492b tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:07.671589 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-376efe8f-3a25-488c-8e0a-9a4db04c492b tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:07.671589 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-376efe8f-3a25-488c-8e0a-9a4db04c492b tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:07.671589 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-376efe8f-3a25-488c-8e0a-9a4db04c492b tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:07.804376 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-376efe8f-3a25-488c-8e0a-9a4db04c492b tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:07.812084 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-376efe8f-3a25-488c-8e0a-9a4db04c492b tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1359 microversion: 2.1 time: 0.155968 Oct 26 11:28:07.812857 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 469/948] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:07 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:28:08.836485 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-6524cf87-5ce5-465a-998d-64c976191c10 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:08.837103 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-6524cf87-5ce5-465a-998d-64c976191c10 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:08.839470 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:28:08.844143 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6524cf87-5ce5-465a-998d-64c976191c10 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:08.844676 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6524cf87-5ce5-465a-998d-64c976191c10 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:08.848897 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6524cf87-5ce5-465a-998d-64c976191c10 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:08.848897 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6524cf87-5ce5-465a-998d-64c976191c10 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:08.848897 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6524cf87-5ce5-465a-998d-64c976191c10 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:08.848897 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6524cf87-5ce5-465a-998d-64c976191c10 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:08.985791 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-6524cf87-5ce5-465a-998d-64c976191c10 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:08.993482 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-6524cf87-5ce5-465a-998d-64c976191c10 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1359 microversion: 2.1 time: 0.161513 Oct 26 11:28:09.006843 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 480/949] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:08 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:28:10.016891 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-cb733479-48f3-4eba-b81a-fad5725e1450 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:10.017559 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-cb733479-48f3-4eba-b81a-fad5725e1450 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:10.024397 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cb733479-48f3-4eba-b81a-fad5725e1450 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:10.024889 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cb733479-48f3-4eba-b81a-fad5725e1450 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:10.025332 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cb733479-48f3-4eba-b81a-fad5725e1450 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:10.026042 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cb733479-48f3-4eba-b81a-fad5725e1450 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:10.026502 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cb733479-48f3-4eba-b81a-fad5725e1450 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:10.026958 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cb733479-48f3-4eba-b81a-fad5725e1450 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:10.160282 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-cb733479-48f3-4eba-b81a-fad5725e1450 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:10.169016 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-cb733479-48f3-4eba-b81a-fad5725e1450 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1359 microversion: 2.1 time: 0.156043 Oct 26 11:28:10.169593 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 470/950] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:10 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:28:11.191615 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-16695c27-9812-4059-94e5-aeea2898af43 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:11.192251 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-16695c27-9812-4059-94e5-aeea2898af43 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:11.194506 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell0:SELECT=2 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:28:11.195531 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell0:SELECT=6 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:28:11.201103 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-16695c27-9812-4059-94e5-aeea2898af43 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:11.201604 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-16695c27-9812-4059-94e5-aeea2898af43 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:11.202114 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-16695c27-9812-4059-94e5-aeea2898af43 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:11.202886 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-16695c27-9812-4059-94e5-aeea2898af43 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:11.203318 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-16695c27-9812-4059-94e5-aeea2898af43 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:11.203738 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-16695c27-9812-4059-94e5-aeea2898af43 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:11.341161 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-16695c27-9812-4059-94e5-aeea2898af43 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:11.349433 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-16695c27-9812-4059-94e5-aeea2898af43 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1359 microversion: 2.1 time: 0.161759 Oct 26 11:28:11.350247 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 481/951] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:11 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:28:12.372166 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-ee727583-ffbb-4b37-943c-34d8ca5b0f5e tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:12.372781 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-ee727583-ffbb-4b37-943c-34d8ca5b0f5e tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:12.374596 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell0:SELECT=6 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:28:12.379979 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ee727583-ffbb-4b37-943c-34d8ca5b0f5e tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:12.380464 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ee727583-ffbb-4b37-943c-34d8ca5b0f5e tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:12.380903 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ee727583-ffbb-4b37-943c-34d8ca5b0f5e tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:12.382094 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ee727583-ffbb-4b37-943c-34d8ca5b0f5e tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:12.382550 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ee727583-ffbb-4b37-943c-34d8ca5b0f5e tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:12.383010 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ee727583-ffbb-4b37-943c-34d8ca5b0f5e tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:12.511342 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-ee727583-ffbb-4b37-943c-34d8ca5b0f5e tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:12.520366 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-ee727583-ffbb-4b37-943c-34d8ca5b0f5e tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1359 microversion: 2.1 time: 0.152041 Oct 26 11:28:12.520957 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 471/952] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:12 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:28:13.544953 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-ea1c55af-1c94-4fa7-8eb7-ee7a0354fe42 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:13.546234 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-ea1c55af-1c94-4fa7-8eb7-ee7a0354fe42 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:13.552599 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ea1c55af-1c94-4fa7-8eb7-ee7a0354fe42 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:13.553088 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ea1c55af-1c94-4fa7-8eb7-ee7a0354fe42 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:13.553514 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ea1c55af-1c94-4fa7-8eb7-ee7a0354fe42 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:13.554242 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ea1c55af-1c94-4fa7-8eb7-ee7a0354fe42 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:13.555391 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ea1c55af-1c94-4fa7-8eb7-ee7a0354fe42 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:13.555806 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ea1c55af-1c94-4fa7-8eb7-ee7a0354fe42 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:13.629907 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-96860c18-67ca-4286-82fd-76bbf918eb5f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:13.630575 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-96860c18-67ca-4286-82fd-76bbf918eb5f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:13.637550 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-96860c18-67ca-4286-82fd-76bbf918eb5f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:13.637681 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-96860c18-67ca-4286-82fd-76bbf918eb5f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:13.640053 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-96860c18-67ca-4286-82fd-76bbf918eb5f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:13.640861 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-96860c18-67ca-4286-82fd-76bbf918eb5f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:13.641341 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-96860c18-67ca-4286-82fd-76bbf918eb5f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:13.641789 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-96860c18-67ca-4286-82fd-76bbf918eb5f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:13.685654 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-96860c18-67ca-4286-82fd-76bbf918eb5f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f/ips" status: 200 len: 149 microversion: 2.1 time: 0.060236 Oct 26 11:28:13.686234 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 472/953] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Oct 26 11:28:13 2022] GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f/ips => generated 149 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:28:13.701318 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ea1c55af-1c94-4fa7-8eb7-ee7a0354fe42 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:13.711344 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-ea1c55af-1c94-4fa7-8eb7-ee7a0354fe42 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1359 microversion: 2.1 time: 0.170423 Oct 26 11:28:13.712418 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 482/954] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:13 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:28:14.735845 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-bf31af84-208e-492a-9ade-173a65ec71d2 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:14.736362 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-bf31af84-208e-492a-9ade-173a65ec71d2 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:14.743249 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bf31af84-208e-492a-9ade-173a65ec71d2 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:14.743728 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bf31af84-208e-492a-9ade-173a65ec71d2 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:14.744158 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bf31af84-208e-492a-9ade-173a65ec71d2 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:14.744842 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bf31af84-208e-492a-9ade-173a65ec71d2 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:14.745287 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bf31af84-208e-492a-9ade-173a65ec71d2 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:14.745702 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bf31af84-208e-492a-9ade-173a65ec71d2 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:14.873204 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-bf31af84-208e-492a-9ade-173a65ec71d2 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:14.880704 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-bf31af84-208e-492a-9ade-173a65ec71d2 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1359 microversion: 2.1 time: 0.148885 Oct 26 11:28:14.881260 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 473/955] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:14 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:28:15.904253 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-529ce71f-d87f-4086-ac54-a600c8a450c6 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:15.904869 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-529ce71f-d87f-4086-ac54-a600c8a450c6 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:15.911347 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-529ce71f-d87f-4086-ac54-a600c8a450c6 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:15.911837 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-529ce71f-d87f-4086-ac54-a600c8a450c6 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:15.912275 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-529ce71f-d87f-4086-ac54-a600c8a450c6 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:15.912967 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-529ce71f-d87f-4086-ac54-a600c8a450c6 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:15.913425 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-529ce71f-d87f-4086-ac54-a600c8a450c6 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:15.913877 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-529ce71f-d87f-4086-ac54-a600c8a450c6 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:16.045277 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-529ce71f-d87f-4086-ac54-a600c8a450c6 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:16.052843 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-529ce71f-d87f-4086-ac54-a600c8a450c6 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1359 microversion: 2.1 time: 0.152533 Oct 26 11:28:16.053405 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 483/956] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:15 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:28:16.379814 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-719bdcdd-7689-4cf4-96e8-af2c57160622 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "111935c6-57e2-42bb-9110-50f6831e948c"}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:28:16.382263 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-719bdcdd-7689-4cf4-96e8-af2c57160622 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:16.389525 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-719bdcdd-7689-4cf4-96e8-af2c57160622 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:16.390004 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-719bdcdd-7689-4cf4-96e8-af2c57160622 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:16.390440 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-719bdcdd-7689-4cf4-96e8-af2c57160622 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:16.391154 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-719bdcdd-7689-4cf4-96e8-af2c57160622 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:16.391603 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-719bdcdd-7689-4cf4-96e8-af2c57160622 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:16.392023 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-719bdcdd-7689-4cf4-96e8-af2c57160622 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:17.075488 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-2bcd4008-1749-4d6e-95f0-92e8d32b3bd2 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:17.076025 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-2bcd4008-1749-4d6e-95f0-92e8d32b3bd2 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:17.082288 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2bcd4008-1749-4d6e-95f0-92e8d32b3bd2 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:17.082763 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2bcd4008-1749-4d6e-95f0-92e8d32b3bd2 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:17.083227 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2bcd4008-1749-4d6e-95f0-92e8d32b3bd2 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:17.083927 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2bcd4008-1749-4d6e-95f0-92e8d32b3bd2 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:17.084353 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2bcd4008-1749-4d6e-95f0-92e8d32b3bd2 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:17.084769 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2bcd4008-1749-4d6e-95f0-92e8d32b3bd2 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:17.217196 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-2bcd4008-1749-4d6e-95f0-92e8d32b3bd2 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:17.225364 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-2bcd4008-1749-4d6e-95f0-92e8d32b3bd2 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1359 microversion: 2.1 time: 0.153727 Oct 26 11:28:17.226274 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 484/957] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:17 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:28:17.988171 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-7eab8a72-acc0-453c-9f1f-57e733f1a1c9 req-01c7f741-6645-4c8b-b18d-1735b3829249 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbf3d5fd-8067-49a1-b4e3-51f5949018d5", "tag": "436d699c-83eb-4925-85b5-851f53994190"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:28:17.998788 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-7eab8a72-acc0-453c-9f1f-57e733f1a1c9 req-01c7f741-6645-4c8b-b18d-1735b3829249 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:18.001575 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-7eab8a72-acc0-453c-9f1f-57e733f1a1c9 req-01c7f741-6645-4c8b-b18d-1735b3829249 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:18.001575 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-7eab8a72-acc0-453c-9f1f-57e733f1a1c9 req-01c7f741-6645-4c8b-b18d-1735b3829249 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:18.013063 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-7eab8a72-acc0-453c-9f1f-57e733f1a1c9 req-01c7f741-6645-4c8b-b18d-1735b3829249 service nova] Creating event network-changed:436d699c-83eb-4925-85b5-851f53994190 for instance cbf3d5fd-8067-49a1-b4e3-51f5949018d5 on hv-cinder-81558 Oct 26 11:28:18.018363 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-7eab8a72-acc0-453c-9f1f-57e733f1a1c9 req-01c7f741-6645-4c8b-b18d-1735b3829249 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033832 Oct 26 11:28:18.018993 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 485/958] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:28:18.248951 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-719bdcdd-7689-4cf4-96e8-af2c57160622 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "POST /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.873291 Oct 26 11:28:18.249606 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 474/959] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Oct 26 11:28:16 2022] POST /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f/os-volume_attachments => generated 194 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:28:18.252325 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-eb18eae5-28fd-499b-82d4-83dbca47a64d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:18.252325 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-eb18eae5-28fd-499b-82d4-83dbca47a64d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:18.258776 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-eb18eae5-28fd-499b-82d4-83dbca47a64d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:18.259352 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-eb18eae5-28fd-499b-82d4-83dbca47a64d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:18.259787 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-eb18eae5-28fd-499b-82d4-83dbca47a64d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:18.260546 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-eb18eae5-28fd-499b-82d4-83dbca47a64d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:18.260998 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-eb18eae5-28fd-499b-82d4-83dbca47a64d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:18.261420 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-eb18eae5-28fd-499b-82d4-83dbca47a64d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:18.391507 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-eb18eae5-28fd-499b-82d4-83dbca47a64d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:18.399799 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-eb18eae5-28fd-499b-82d4-83dbca47a64d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1359 microversion: 2.1 time: 0.153736 Oct 26 11:28:18.401138 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 486/960] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:18 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:28:19.425131 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-f8810455-3393-43a2-9de7-0cda31f40ebf tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:19.425839 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-f8810455-3393-43a2-9de7-0cda31f40ebf tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:19.432583 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f8810455-3393-43a2-9de7-0cda31f40ebf tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:19.433063 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f8810455-3393-43a2-9de7-0cda31f40ebf tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:19.433501 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f8810455-3393-43a2-9de7-0cda31f40ebf tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:19.434191 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f8810455-3393-43a2-9de7-0cda31f40ebf tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:19.434647 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f8810455-3393-43a2-9de7-0cda31f40ebf tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:19.435102 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f8810455-3393-43a2-9de7-0cda31f40ebf tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:19.564445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-f8810455-3393-43a2-9de7-0cda31f40ebf tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:19.572007 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-f8810455-3393-43a2-9de7-0cda31f40ebf tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1359 microversion: 2.1 time: 0.151665 Oct 26 11:28:19.572510 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 475/961] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:19 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:28:20.594740 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-77207ef5-62d2-4e8f-afda-dfade69da90a tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:20.595386 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-77207ef5-62d2-4e8f-afda-dfade69da90a tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:20.601664 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-77207ef5-62d2-4e8f-afda-dfade69da90a tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:20.602140 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-77207ef5-62d2-4e8f-afda-dfade69da90a tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:20.602569 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-77207ef5-62d2-4e8f-afda-dfade69da90a tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:20.603279 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-77207ef5-62d2-4e8f-afda-dfade69da90a tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:20.603729 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-77207ef5-62d2-4e8f-afda-dfade69da90a tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:20.604146 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-77207ef5-62d2-4e8f-afda-dfade69da90a tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:20.728691 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-77207ef5-62d2-4e8f-afda-dfade69da90a tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:20.739063 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-77207ef5-62d2-4e8f-afda-dfade69da90a tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1359 microversion: 2.1 time: 0.145429 Oct 26 11:28:20.739063 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 487/962] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:20 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:28:21.760831 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-fb161ce3-271e-49be-bdd2-4cd460669067 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:21.761445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-fb161ce3-271e-49be-bdd2-4cd460669067 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:21.767798 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fb161ce3-271e-49be-bdd2-4cd460669067 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:21.768499 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fb161ce3-271e-49be-bdd2-4cd460669067 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:21.768935 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fb161ce3-271e-49be-bdd2-4cd460669067 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:21.769632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fb161ce3-271e-49be-bdd2-4cd460669067 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:21.770089 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fb161ce3-271e-49be-bdd2-4cd460669067 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:21.770512 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fb161ce3-271e-49be-bdd2-4cd460669067 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:21.903439 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-fb161ce3-271e-49be-bdd2-4cd460669067 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:21.911064 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-fb161ce3-271e-49be-bdd2-4cd460669067 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1359 microversion: 2.1 time: 0.154547 Oct 26 11:28:21.911625 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 476/963] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:21 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:28:22.933541 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-53894202-0e77-4a41-adfd-e0c08cd1e77e tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:22.934173 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-53894202-0e77-4a41-adfd-e0c08cd1e77e tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:22.940702 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-53894202-0e77-4a41-adfd-e0c08cd1e77e tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:22.941191 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-53894202-0e77-4a41-adfd-e0c08cd1e77e tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:22.941648 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-53894202-0e77-4a41-adfd-e0c08cd1e77e tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:22.942334 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-53894202-0e77-4a41-adfd-e0c08cd1e77e tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:22.942781 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-53894202-0e77-4a41-adfd-e0c08cd1e77e tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:22.943223 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-53894202-0e77-4a41-adfd-e0c08cd1e77e tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:23.071608 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-53894202-0e77-4a41-adfd-e0c08cd1e77e tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:23.079263 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-53894202-0e77-4a41-adfd-e0c08cd1e77e tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1359 microversion: 2.1 time: 0.149669 Oct 26 11:28:23.079841 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 488/964] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:22 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:28:24.102324 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-e75dda0a-c223-4cce-a9c9-ed754c263c69 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:24.102965 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-e75dda0a-c223-4cce-a9c9-ed754c263c69 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:24.109548 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e75dda0a-c223-4cce-a9c9-ed754c263c69 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:24.110777 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e75dda0a-c223-4cce-a9c9-ed754c263c69 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:24.110777 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e75dda0a-c223-4cce-a9c9-ed754c263c69 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:24.111186 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e75dda0a-c223-4cce-a9c9-ed754c263c69 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:24.111641 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e75dda0a-c223-4cce-a9c9-ed754c263c69 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:24.112066 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e75dda0a-c223-4cce-a9c9-ed754c263c69 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:24.234439 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-e75dda0a-c223-4cce-a9c9-ed754c263c69 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:24.241974 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-e75dda0a-c223-4cce-a9c9-ed754c263c69 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1359 microversion: 2.1 time: 0.144016 Oct 26 11:28:24.243163 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 477/965] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:24 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:28:25.264994 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-b9918e46-10bb-48bc-9758-75f25fe17305 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:25.265531 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-b9918e46-10bb-48bc-9758-75f25fe17305 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:25.271794 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b9918e46-10bb-48bc-9758-75f25fe17305 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:25.272529 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b9918e46-10bb-48bc-9758-75f25fe17305 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:25.272955 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b9918e46-10bb-48bc-9758-75f25fe17305 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:25.273649 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b9918e46-10bb-48bc-9758-75f25fe17305 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:25.274099 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b9918e46-10bb-48bc-9758-75f25fe17305 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:25.274517 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b9918e46-10bb-48bc-9758-75f25fe17305 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:25.278467 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=98 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:28:25.397594 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-b9918e46-10bb-48bc-9758-75f25fe17305 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:25.405042 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-b9918e46-10bb-48bc-9758-75f25fe17305 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1359 microversion: 2.1 time: 0.144000 Oct 26 11:28:25.405605 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 489/966] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:25 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1359 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:28:26.427734 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-5aeae7fc-d811-4c47-b22c-c7b21a81e9fc tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:26.428345 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-5aeae7fc-d811-4c47-b22c-c7b21a81e9fc tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:26.434806 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5aeae7fc-d811-4c47-b22c-c7b21a81e9fc tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:26.435305 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5aeae7fc-d811-4c47-b22c-c7b21a81e9fc tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:26.435737 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5aeae7fc-d811-4c47-b22c-c7b21a81e9fc tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:26.436465 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5aeae7fc-d811-4c47-b22c-c7b21a81e9fc tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:26.436913 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5aeae7fc-d811-4c47-b22c-c7b21a81e9fc tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:26.437335 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5aeae7fc-d811-4c47-b22c-c7b21a81e9fc tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:26.497438 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-a2aa3d9f-228d-4dba-8249-65b91a749124 req-7255dda6-5c1f-40f2-bf43-49ea4e9b5193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbf3d5fd-8067-49a1-b4e3-51f5949018d5", "name": "network-vif-plugged", "status": "completed", "tag": "436d699c-83eb-4925-85b5-851f53994190"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:28:26.507394 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-a2aa3d9f-228d-4dba-8249-65b91a749124 req-7255dda6-5c1f-40f2-bf43-49ea4e9b5193 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:26.507876 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-a2aa3d9f-228d-4dba-8249-65b91a749124 req-7255dda6-5c1f-40f2-bf43-49ea4e9b5193 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:26.508799 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-a2aa3d9f-228d-4dba-8249-65b91a749124 req-7255dda6-5c1f-40f2-bf43-49ea4e9b5193 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:26.519701 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-a2aa3d9f-228d-4dba-8249-65b91a749124 req-7255dda6-5c1f-40f2-bf43-49ea4e9b5193 service nova] Creating event network-vif-plugged:436d699c-83eb-4925-85b5-851f53994190 for instance cbf3d5fd-8067-49a1-b4e3-51f5949018d5 on hv-cinder-81558 Oct 26 11:28:26.525455 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-a2aa3d9f-228d-4dba-8249-65b91a749124 req-7255dda6-5c1f-40f2-bf43-49ea4e9b5193 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032512 Oct 26 11:28:26.526048 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 490/967] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:28:26.573102 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-5aeae7fc-d811-4c47-b22c-c7b21a81e9fc tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:26.582621 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-5aeae7fc-d811-4c47-b22c-c7b21a81e9fc tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1359 microversion: 2.1 time: 0.158650 Oct 26 11:28:26.583951 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 478/968] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:26 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:28:27.608808 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-d99ffe25-2f5c-47bf-b758-307e07af3eba tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:27.609534 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-d99ffe25-2f5c-47bf-b758-307e07af3eba tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:27.615657 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d99ffe25-2f5c-47bf-b758-307e07af3eba tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:27.616133 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d99ffe25-2f5c-47bf-b758-307e07af3eba tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:27.616567 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d99ffe25-2f5c-47bf-b758-307e07af3eba tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:27.617255 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d99ffe25-2f5c-47bf-b758-307e07af3eba tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:27.617727 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d99ffe25-2f5c-47bf-b758-307e07af3eba tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:27.618148 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d99ffe25-2f5c-47bf-b758-307e07af3eba tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:27.744903 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-d99ffe25-2f5c-47bf-b758-307e07af3eba tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:27.752551 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-d99ffe25-2f5c-47bf-b758-307e07af3eba tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1359 microversion: 2.1 time: 0.148667 Oct 26 11:28:27.753317 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 491/969] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:27 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:28:28.776650 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-6b4d9a32-b57e-4ad4-9b97-1c42e73e8ed4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:28.777330 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-6b4d9a32-b57e-4ad4-9b97-1c42e73e8ed4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:28.783812 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6b4d9a32-b57e-4ad4-9b97-1c42e73e8ed4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:28.784292 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6b4d9a32-b57e-4ad4-9b97-1c42e73e8ed4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:28.784725 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6b4d9a32-b57e-4ad4-9b97-1c42e73e8ed4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:28.785436 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6b4d9a32-b57e-4ad4-9b97-1c42e73e8ed4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:28.785954 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6b4d9a32-b57e-4ad4-9b97-1c42e73e8ed4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:28.786375 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6b4d9a32-b57e-4ad4-9b97-1c42e73e8ed4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:28.914679 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-6b4d9a32-b57e-4ad4-9b97-1c42e73e8ed4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:28.922330 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-6b4d9a32-b57e-4ad4-9b97-1c42e73e8ed4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1359 microversion: 2.1 time: 0.150287 Oct 26 11:28:28.922949 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 479/970] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:28 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:28:29.945252 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e3e8a5ca-76dc-4242-935f-9d79c2e788d1 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:29.945862 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-e3e8a5ca-76dc-4242-935f-9d79c2e788d1 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:29.951939 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e3e8a5ca-76dc-4242-935f-9d79c2e788d1 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:29.952650 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e3e8a5ca-76dc-4242-935f-9d79c2e788d1 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:29.952844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e3e8a5ca-76dc-4242-935f-9d79c2e788d1 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:29.953536 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e3e8a5ca-76dc-4242-935f-9d79c2e788d1 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:29.953984 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e3e8a5ca-76dc-4242-935f-9d79c2e788d1 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:29.954400 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e3e8a5ca-76dc-4242-935f-9d79c2e788d1 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:30.091764 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-e3e8a5ca-76dc-4242-935f-9d79c2e788d1 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:30.100609 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-e3e8a5ca-76dc-4242-935f-9d79c2e788d1 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1359 microversion: 2.1 time: 0.159083 Oct 26 11:28:30.101318 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 492/971] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:29 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:28:30.119719 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-2626bd22-ea3d-482c-8330-c90b492fa7b5 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:30.120246 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-2626bd22-ea3d-482c-8330-c90b492fa7b5 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:30.126752 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2626bd22-ea3d-482c-8330-c90b492fa7b5 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:30.127361 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2626bd22-ea3d-482c-8330-c90b492fa7b5 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:30.127799 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2626bd22-ea3d-482c-8330-c90b492fa7b5 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:30.128554 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2626bd22-ea3d-482c-8330-c90b492fa7b5 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:30.129016 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2626bd22-ea3d-482c-8330-c90b492fa7b5 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:30.129442 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2626bd22-ea3d-482c-8330-c90b492fa7b5 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:30.210294 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.objects.instance [None req-2626bd22-ea3d-482c-8330-c90b492fa7b5 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lazy-loading 'services' on Instance uuid d7f58550-4456-4d0f-b050-e0be7959139f {{(pid=119305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:28:30.365270 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-2626bd22-ea3d-482c-8330-c90b492fa7b5 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f/os-volume_attachments/111935c6-57e2-42bb-9110-50f6831e948c" status: 202 len: 0 microversion: 2.1 time: 0.249581 Oct 26 11:28:30.365856 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 480/972] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Oct 26 11:28:30 2022] DELETE /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f/os-volume_attachments/111935c6-57e2-42bb-9110-50f6831e948c => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 11:28:30.376015 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-50a24c5d-1a38-4b64-91ea-131459bbd28e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:30.378159 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-50a24c5d-1a38-4b64-91ea-131459bbd28e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:30.384778 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-50a24c5d-1a38-4b64-91ea-131459bbd28e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:30.385258 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-50a24c5d-1a38-4b64-91ea-131459bbd28e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:30.385687 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-50a24c5d-1a38-4b64-91ea-131459bbd28e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:30.386368 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-50a24c5d-1a38-4b64-91ea-131459bbd28e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:30.386878 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-50a24c5d-1a38-4b64-91ea-131459bbd28e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:30.387299 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-50a24c5d-1a38-4b64-91ea-131459bbd28e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:30.416266 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-50a24c5d-1a38-4b64-91ea-131459bbd28e tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045546 Oct 26 11:28:30.416831 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 493/973] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Oct 26 11:28:30 2022] GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:28:31.123398 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-1a2ab7d0-adb7-4842-828b-846922fe037d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:31.124106 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-1a2ab7d0-adb7-4842-828b-846922fe037d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:31.130751 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1a2ab7d0-adb7-4842-828b-846922fe037d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:31.131264 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1a2ab7d0-adb7-4842-828b-846922fe037d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:31.131702 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1a2ab7d0-adb7-4842-828b-846922fe037d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:31.132396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1a2ab7d0-adb7-4842-828b-846922fe037d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:31.132855 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1a2ab7d0-adb7-4842-828b-846922fe037d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:31.133286 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1a2ab7d0-adb7-4842-828b-846922fe037d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:31.262940 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-1a2ab7d0-adb7-4842-828b-846922fe037d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:31.270547 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-1a2ab7d0-adb7-4842-828b-846922fe037d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1549 microversion: 2.1 time: 0.151561 Oct 26 11:28:31.271144 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 481/974] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:31 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:28:31.294312 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-9bec074f-6233-4323-a389-3d20db304657 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:31.294942 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-9bec074f-6233-4323-a389-3d20db304657 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:31.301169 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9bec074f-6233-4323-a389-3d20db304657 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:31.301641 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9bec074f-6233-4323-a389-3d20db304657 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:31.302070 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9bec074f-6233-4323-a389-3d20db304657 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:31.302743 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9bec074f-6233-4323-a389-3d20db304657 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:31.303211 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9bec074f-6233-4323-a389-3d20db304657 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:31.303630 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9bec074f-6233-4323-a389-3d20db304657 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:31.432846 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-33a503d3-140d-43e2-a22b-fcff07113a47 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:31.432999 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-9bec074f-6233-4323-a389-3d20db304657 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:31.433127 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-33a503d3-140d-43e2-a22b-fcff07113a47 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:31.437081 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-33a503d3-140d-43e2-a22b-fcff07113a47 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:31.437573 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-33a503d3-140d-43e2-a22b-fcff07113a47 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:31.437795 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-9bec074f-6233-4323-a389-3d20db304657 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1549 microversion: 2.1 time: 0.147435 Oct 26 11:28:31.438011 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-33a503d3-140d-43e2-a22b-fcff07113a47 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:31.438466 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 494/975] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:31 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:28:31.438743 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-33a503d3-140d-43e2-a22b-fcff07113a47 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:31.439226 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-33a503d3-140d-43e2-a22b-fcff07113a47 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:31.439653 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-33a503d3-140d-43e2-a22b-fcff07113a47 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:31.459449 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-2a3e2186-3066-47cb-92b2-05cdd33e9be7 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:31.464319 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:28:31.464976 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-2a3e2186-3066-47cb-92b2-05cdd33e9be7 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:31.465503 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-2a3e2186-3066-47cb-92b2-05cdd33e9be7 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Searching by: {'deleted': False, 'project_id': 'a975701f3c69481b874e106eb5d4edcd'} {{(pid=119306) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 26 11:28:31.470692 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-33a503d3-140d-43e2-a22b-fcff07113a47 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045845 Oct 26 11:28:31.471324 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 482/976] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Oct 26 11:28:31 2022] GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:28:31.472498 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2a3e2186-3066-47cb-92b2-05cdd33e9be7 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:31.472980 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2a3e2186-3066-47cb-92b2-05cdd33e9be7 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:31.473443 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2a3e2186-3066-47cb-92b2-05cdd33e9be7 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:31.474167 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2a3e2186-3066-47cb-92b2-05cdd33e9be7 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:31.474621 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2a3e2186-3066-47cb-92b2-05cdd33e9be7 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:31.475075 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2a3e2186-3066-47cb-92b2-05cdd33e9be7 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:31.568131 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.multi_cell_list [None req-2a3e2186-3066-47cb-92b2-05cdd33e9be7 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119306) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 26 11:28:31.667966 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-2a3e2186-3066-47cb-92b2-05cdd33e9be7 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.212106 Oct 26 11:28:31.668552 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 495/977] 10.222.0.42 () {58 vars in 1125 bytes} [Wed Oct 26 11:28:31 2022] GET /compute/v2.1/servers => generated 343 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:28:31.680313 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-52cfd0ae-e0d7-4a44-ace5-9765245de811 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:31.680918 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-52cfd0ae-e0d7-4a44-ace5-9765245de811 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:31.687447 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-52cfd0ae-e0d7-4a44-ace5-9765245de811 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:31.687929 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-52cfd0ae-e0d7-4a44-ace5-9765245de811 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:31.694144 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-52cfd0ae-e0d7-4a44-ace5-9765245de811 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:31.694144 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-52cfd0ae-e0d7-4a44-ace5-9765245de811 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:31.694144 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-52cfd0ae-e0d7-4a44-ace5-9765245de811 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:31.694144 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-52cfd0ae-e0d7-4a44-ace5-9765245de811 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:31.817723 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-52cfd0ae-e0d7-4a44-ace5-9765245de811 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:31.825946 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-52cfd0ae-e0d7-4a44-ace5-9765245de811 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1549 microversion: 2.1 time: 0.149607 Oct 26 11:28:31.826518 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 483/978] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:31 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:28:32.483125 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-12af4186-c1a6-4662-8b21-ba2777d52cd2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:32.485358 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-12af4186-c1a6-4662-8b21-ba2777d52cd2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:32.494772 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-12af4186-c1a6-4662-8b21-ba2777d52cd2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:32.494772 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-12af4186-c1a6-4662-8b21-ba2777d52cd2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:32.494772 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-12af4186-c1a6-4662-8b21-ba2777d52cd2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:32.494772 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-12af4186-c1a6-4662-8b21-ba2777d52cd2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:32.495188 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-12af4186-c1a6-4662-8b21-ba2777d52cd2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:32.495188 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-12af4186-c1a6-4662-8b21-ba2777d52cd2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:32.524124 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-12af4186-c1a6-4662-8b21-ba2777d52cd2 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045028 Oct 26 11:28:32.524685 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 496/979] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Oct 26 11:28:32 2022] GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 11:28:32.587388 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-e2022cfe-b7ce-4eee-a08c-66f86164ea16 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:32.587907 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-e2022cfe-b7ce-4eee-a08c-66f86164ea16 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:32.594879 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e2022cfe-b7ce-4eee-a08c-66f86164ea16 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:32.595359 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e2022cfe-b7ce-4eee-a08c-66f86164ea16 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:32.595790 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e2022cfe-b7ce-4eee-a08c-66f86164ea16 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:32.596517 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e2022cfe-b7ce-4eee-a08c-66f86164ea16 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:32.596990 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e2022cfe-b7ce-4eee-a08c-66f86164ea16 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:32.597408 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e2022cfe-b7ce-4eee-a08c-66f86164ea16 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:32.624372 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-e2022cfe-b7ce-4eee-a08c-66f86164ea16 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Going to try to terminate instance {{(pid=119305) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 11:28:32.902007 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-e2022cfe-b7ce-4eee-a08c-66f86164ea16 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f" status: 204 len: 0 microversion: 2.1 time: 0.318837 Oct 26 11:28:32.902621 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 484/980] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Oct 26 11:28:32 2022] DELETE /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 11:28:32.910690 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-5b783a37-04f1-46af-9e0a-9751af6dd684 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:32.911384 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-5b783a37-04f1-46af-9e0a-9751af6dd684 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:32.917852 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5b783a37-04f1-46af-9e0a-9751af6dd684 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:32.918328 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5b783a37-04f1-46af-9e0a-9751af6dd684 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:32.918753 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5b783a37-04f1-46af-9e0a-9751af6dd684 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:32.919460 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5b783a37-04f1-46af-9e0a-9751af6dd684 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:32.919906 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5b783a37-04f1-46af-9e0a-9751af6dd684 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:32.920322 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5b783a37-04f1-46af-9e0a-9751af6dd684 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:33.048174 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-5b783a37-04f1-46af-9e0a-9751af6dd684 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:33.055726 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-5b783a37-04f1-46af-9e0a-9751af6dd684 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f" status: 200 len: 1679 microversion: 2.1 time: 0.148871 Oct 26 11:28:33.056300 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 497/981] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:32 2022] GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:28:34.079885 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-5e35ebbb-f78c-41f1-b49a-e15af4e4955a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:34.080509 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-5e35ebbb-f78c-41f1-b49a-e15af4e4955a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:34.087436 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5e35ebbb-f78c-41f1-b49a-e15af4e4955a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:34.087915 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5e35ebbb-f78c-41f1-b49a-e15af4e4955a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:34.088442 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5e35ebbb-f78c-41f1-b49a-e15af4e4955a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:34.089126 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5e35ebbb-f78c-41f1-b49a-e15af4e4955a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:34.089578 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5e35ebbb-f78c-41f1-b49a-e15af4e4955a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:34.089999 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5e35ebbb-f78c-41f1-b49a-e15af4e4955a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:34.218070 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-5e35ebbb-f78c-41f1-b49a-e15af4e4955a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:34.225605 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-5e35ebbb-f78c-41f1-b49a-e15af4e4955a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f" status: 200 len: 1679 microversion: 2.1 time: 0.150049 Oct 26 11:28:34.226178 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 485/982] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:34 2022] GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:28:34.721505 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e2df842b-e274-4638-8a65-594b32760a56 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b60e159b-f7a7-4e53-800b-86084e888b6b"}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:28:34.724435 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-e2df842b-e274-4638-8a65-594b32760a56 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:34.730363 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2df842b-e274-4638-8a65-594b32760a56 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:34.730881 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2df842b-e274-4638-8a65-594b32760a56 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:34.731314 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2df842b-e274-4638-8a65-594b32760a56 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:34.732007 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2df842b-e274-4638-8a65-594b32760a56 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:34.732458 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2df842b-e274-4638-8a65-594b32760a56 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:34.732878 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2df842b-e274-4638-8a65-594b32760a56 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:35.251849 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-3f0d70fe-92ca-4936-aecb-fac7904a7efb tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:35.253526 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-3f0d70fe-92ca-4936-aecb-fac7904a7efb tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:35.261676 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3f0d70fe-92ca-4936-aecb-fac7904a7efb tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:35.262231 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3f0d70fe-92ca-4936-aecb-fac7904a7efb tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:35.262665 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3f0d70fe-92ca-4936-aecb-fac7904a7efb tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:35.263387 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3f0d70fe-92ca-4936-aecb-fac7904a7efb tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:35.263840 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3f0d70fe-92ca-4936-aecb-fac7904a7efb tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:35.264265 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3f0d70fe-92ca-4936-aecb-fac7904a7efb tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:35.427819 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-e2df842b-e274-4638-8a65-594b32760a56 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "POST /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.710169 Oct 26 11:28:35.428444 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 498/983] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Oct 26 11:28:34 2022] POST /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5/os-volume_attachments => generated 194 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:28:35.488691 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-3f0d70fe-92ca-4936-aecb-fac7904a7efb tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:35.497548 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-3f0d70fe-92ca-4936-aecb-fac7904a7efb tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f" status: 200 len: 1679 microversion: 2.1 time: 0.251088 Oct 26 11:28:35.498167 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 486/984] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:35 2022] GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f => generated 1679 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:28:36.390524 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-4912cb36-67ad-4398-8c9e-56a2177982a5 req-89978431-dda1-49f9-98f2-02cd4a70b3cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f58550-4456-4d0f-b050-e0be7959139f", "name": "network-vif-deleted", "tag": "7b01f1f3-91ab-48bc-ba7f-676d9f2823c0"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:28:36.400910 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-4912cb36-67ad-4398-8c9e-56a2177982a5 req-89978431-dda1-49f9-98f2-02cd4a70b3cb service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:36.401546 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-4912cb36-67ad-4398-8c9e-56a2177982a5 req-89978431-dda1-49f9-98f2-02cd4a70b3cb service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:36.402182 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-4912cb36-67ad-4398-8c9e-56a2177982a5 req-89978431-dda1-49f9-98f2-02cd4a70b3cb service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:36.417987 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-4912cb36-67ad-4398-8c9e-56a2177982a5 req-89978431-dda1-49f9-98f2-02cd4a70b3cb service nova] Creating event network-vif-deleted:7b01f1f3-91ab-48bc-ba7f-676d9f2823c0 for instance d7f58550-4456-4d0f-b050-e0be7959139f on hv-cinder-81558 Oct 26 11:28:36.418895 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-4912cb36-67ad-4398-8c9e-56a2177982a5 req-89978431-dda1-49f9-98f2-02cd4a70b3cb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032869 Oct 26 11:28:36.419567 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 499/985] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:28:36.521784 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-193f05e6-b917-429b-9aea-ce2faad5577f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:36.522758 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-193f05e6-b917-429b-9aea-ce2faad5577f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:36.531083 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-193f05e6-b917-429b-9aea-ce2faad5577f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:36.531571 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-193f05e6-b917-429b-9aea-ce2faad5577f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:36.532234 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-193f05e6-b917-429b-9aea-ce2faad5577f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:36.533296 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-193f05e6-b917-429b-9aea-ce2faad5577f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:36.534372 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-193f05e6-b917-429b-9aea-ce2faad5577f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:36.535295 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-193f05e6-b917-429b-9aea-ce2faad5577f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:36.602794 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-193f05e6-b917-429b-9aea-ce2faad5577f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031dd9da25146eebb8813dc8bad8b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724121c2144843b7adc7e17312613c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:36.610863 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-193f05e6-b917-429b-9aea-ce2faad5577f tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f" status: 200 len: 1325 microversion: 2.1 time: 0.093803 Oct 26 11:28:36.611647 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 487/986] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:36 2022] GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f => generated 1325 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:28:37.636078 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-0f91e13b-e8f3-4396-98cd-877dbda41609 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:37.636805 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-0f91e13b-e8f3-4396-98cd-877dbda41609 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:37.642780 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0f91e13b-e8f3-4396-98cd-877dbda41609 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:37.643315 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0f91e13b-e8f3-4396-98cd-877dbda41609 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:37.643747 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0f91e13b-e8f3-4396-98cd-877dbda41609 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:37.644431 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0f91e13b-e8f3-4396-98cd-877dbda41609 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:37.644880 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0f91e13b-e8f3-4396-98cd-877dbda41609 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:37.645302 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0f91e13b-e8f3-4396-98cd-877dbda41609 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:37.659191 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.wsgi [None req-0f91e13b-e8f3-4396-98cd-877dbda41609 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] HTTP exception thrown: Instance d7f58550-4456-4d0f-b050-e0be7959139f could not be found. Oct 26 11:28:37.660873 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-0f91e13b-e8f3-4396-98cd-877dbda41609 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Request method failure captured: Oct 26 11:28:37.660873 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: request: GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f HTTP/1.1 Oct 26 11:28:37.660873 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept: application/json Oct 26 11:28:37.660873 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept-Encoding: identity Oct 26 11:28:37.660873 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Connection: close Oct 26 11:28:37.660873 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Length: 0 Oct 26 11:28:37.660873 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Type: application/json Oct 26 11:28:37.660873 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Host: 10.222.0.42 Oct 26 11:28:37.660873 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Openstack-System-Scope: None Oct 26 11:28:37.660873 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: User-Agent: python-urllib3/1.26.12 Oct 26 11:28:37.660873 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Auth-Token: gAAAAABjWRd0c_l4dNmZmsslzgq0Y1mw7cHb2LyArYA_xomuSGUALJJhwUTg-8wegSnjp12OMWl50wz-0CzDaxBHziSvRsAIfgm9nG8oyGTTyhi4gK_QpH-0WiSM5GZmswPu8j2lHFCwK-c7q-bBx1gr_dj9FZxEy_m8cDa2tIsj3jWPztpcm3k Oct 26 11:28:37.660873 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Id: None Oct 26 11:28:37.660873 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Name: None Oct 26 11:28:37.660873 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Identity-Status: Confirmed Oct 26 11:28:37.660873 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Is-Admin-Project: True Oct 26 11:28:37.660873 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Id: default Oct 26 11:28:37.660873 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Name: Default Oct 26 11:28:37.660873 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Id: 724121c2144843b7adc7e17312613c9d Oct 26 11:28:37.660873 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:28:37.660873 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Role: member,reader Oct 26 11:28:37.660873 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Roles: member,reader Oct 26 11:28:37.662522 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_724121c2144843b7adc7e17312613c9d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724121c2144843b7adc7e17312613c9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/724121c2144843b7adc7e17312613c9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724121c2144843b7adc7e17312613c9d"}]}] Oct 26 11:28:37.662522 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:28:37.662522 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Id: 724121c2144843b7adc7e17312613c9d Oct 26 11:28:37.662522 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:28:37.662522 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User: tempest-AttachVolumeNegativeTest-1560590927-project Oct 26 11:28:37.662522 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Id: default Oct 26 11:28:37.662522 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Name: Default Oct 26 11:28:37.662522 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Id: e031dd9da25146eebb8813dc8bad8b85 Oct 26 11:28:37.662522 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Name: tempest-AttachVolumeNegativeTest-1560590927-project Oct 26 11:28:37.662522 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: method: > Oct 26 11:28:37.662522 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: exception: Instance d7f58550-4456-4d0f-b050-e0be7959139f could not be found. Oct 26 11:28:37.662522 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: action_args: {'id': 'd7f58550-4456-4d0f-b050-e0be7959139f'} Oct 26 11:28:37.663936 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:28:37.663936 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:37.663936 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:28:37.663936 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:28:37.663936 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:28:37.663936 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:28:37.663936 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:28:37.663936 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:28:37.663936 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:28:37.663936 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:28:37.663936 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7f58550-4456-4d0f-b050-e0be7959139f could not be found. Oct 26 11:28:37.663936 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:37.663936 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:37.663936 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:37.663936 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:37.663936 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:28:37.663936 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:28:37.663936 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:28:37.663936 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:28:37.663936 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:28:37.665374 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:28:37.665374 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 11:28:37.665374 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 11:28:37.665374 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:28:37.665374 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:28:37.665374 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:28:37.665374 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:28:37.665374 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7f58550-4456-4d0f-b050-e0be7959139f could not be found. Oct 26 11:28:37.665374 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:37.665374 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:37.665374 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:37.665374 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:37.665374 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:28:37.665374 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:28:37.665374 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:28:37.665374 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:28:37.665374 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7f58550-4456-4d0f-b050-e0be7959139f could not be found. Oct 26 11:28:37.665374 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:37.666583 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-0f91e13b-e8f3-4396-98cd-877dbda41609 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Returning 404 to user: Instance d7f58550-4456-4d0f-b050-e0be7959139f could not be found. {{(pid=119306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:28:37.666583 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-0f91e13b-e8f3-4396-98cd-877dbda41609 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f" status: 404 len: 111 microversion: 2.1 time: 0.031381 Oct 26 11:28:37.666583 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 500/987] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:37 2022] GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:28:37.671198 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-4f030eb8-f5a3-4d68-9e60-f5713c04a648 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '.version_select at 0x7f6b937758b0>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:37.771777 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-4f030eb8-f5a3-4d68-9e60-f5713c04a648 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-738686060" status: 202 len: 0 microversion: 2.1 time: 0.104296 Oct 26 11:28:37.772615 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 488/988] 10.222.0.42 () {58 vars in 1218 bytes} [Wed Oct 26 11:28:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-738686060 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 11:28:39.777908 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-adc68b1c-aaea-44ef-800f-0c1daac97fa1 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:39.778399 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-adc68b1c-aaea-44ef-800f-0c1daac97fa1 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:39.780965 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=42 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:28:39.785564 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-adc68b1c-aaea-44ef-800f-0c1daac97fa1 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:39.786036 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-adc68b1c-aaea-44ef-800f-0c1daac97fa1 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:39.786467 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-adc68b1c-aaea-44ef-800f-0c1daac97fa1 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:39.787214 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-adc68b1c-aaea-44ef-800f-0c1daac97fa1 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:39.787692 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-adc68b1c-aaea-44ef-800f-0c1daac97fa1 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:39.789068 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-adc68b1c-aaea-44ef-800f-0c1daac97fa1 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:39.802168 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.wsgi [None req-adc68b1c-aaea-44ef-800f-0c1daac97fa1 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] HTTP exception thrown: Instance d7f58550-4456-4d0f-b050-e0be7959139f could not be found. Oct 26 11:28:39.803721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-adc68b1c-aaea-44ef-800f-0c1daac97fa1 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Request method failure captured: Oct 26 11:28:39.803721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: request: DELETE /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f HTTP/1.1 Oct 26 11:28:39.803721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept: application/json Oct 26 11:28:39.803721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept-Encoding: identity Oct 26 11:28:39.803721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Connection: close Oct 26 11:28:39.803721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Length: 0 Oct 26 11:28:39.803721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Type: application/json Oct 26 11:28:39.803721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Host: 10.222.0.42 Oct 26 11:28:39.803721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Openstack-System-Scope: None Oct 26 11:28:39.803721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: User-Agent: python-urllib3/1.26.12 Oct 26 11:28:39.803721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Auth-Token: gAAAAABjWRd0c_l4dNmZmsslzgq0Y1mw7cHb2LyArYA_xomuSGUALJJhwUTg-8wegSnjp12OMWl50wz-0CzDaxBHziSvRsAIfgm9nG8oyGTTyhi4gK_QpH-0WiSM5GZmswPu8j2lHFCwK-c7q-bBx1gr_dj9FZxEy_m8cDa2tIsj3jWPztpcm3k Oct 26 11:28:39.803721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Id: None Oct 26 11:28:39.803721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Name: None Oct 26 11:28:39.803721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Identity-Status: Confirmed Oct 26 11:28:39.803721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Is-Admin-Project: True Oct 26 11:28:39.803721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Id: default Oct 26 11:28:39.803721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Name: Default Oct 26 11:28:39.803721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Id: 724121c2144843b7adc7e17312613c9d Oct 26 11:28:39.803721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:28:39.803721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Role: member,reader Oct 26 11:28:39.803721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Roles: member,reader Oct 26 11:28:39.805309 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_724121c2144843b7adc7e17312613c9d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724121c2144843b7adc7e17312613c9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/724121c2144843b7adc7e17312613c9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724121c2144843b7adc7e17312613c9d"}]}] Oct 26 11:28:39.805309 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:28:39.805309 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Id: 724121c2144843b7adc7e17312613c9d Oct 26 11:28:39.805309 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:28:39.805309 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User: tempest-AttachVolumeNegativeTest-1560590927-project Oct 26 11:28:39.805309 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Id: default Oct 26 11:28:39.805309 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Name: Default Oct 26 11:28:39.805309 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Id: e031dd9da25146eebb8813dc8bad8b85 Oct 26 11:28:39.805309 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Name: tempest-AttachVolumeNegativeTest-1560590927-project Oct 26 11:28:39.805309 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: method: > Oct 26 11:28:39.805309 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: exception: Instance d7f58550-4456-4d0f-b050-e0be7959139f could not be found. Oct 26 11:28:39.805309 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: action_args: {'id': 'd7f58550-4456-4d0f-b050-e0be7959139f'} Oct 26 11:28:39.806131 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:28:39.806131 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:39.806131 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:28:39.806131 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:28:39.806131 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:28:39.806131 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:28:39.806131 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:28:39.806131 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:28:39.806131 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:28:39.806131 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:28:39.806131 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7f58550-4456-4d0f-b050-e0be7959139f could not be found. Oct 26 11:28:39.806131 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:39.806131 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:39.806131 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:39.806131 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:39.806131 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:28:39.806131 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:28:39.806131 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:28:39.806131 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:28:39.806131 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:28:39.807396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:28:39.807396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 11:28:39.807396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 11:28:39.807396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 11:28:39.807396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 11:28:39.807396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:28:39.807396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:28:39.807396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:28:39.807396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:28:39.807396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7f58550-4456-4d0f-b050-e0be7959139f could not be found. Oct 26 11:28:39.807396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:39.807396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:39.807396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:39.807396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:39.807396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:28:39.807396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:28:39.807396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:28:39.807396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:28:39.807396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7f58550-4456-4d0f-b050-e0be7959139f could not be found. Oct 26 11:28:39.807396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:39.808614 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-adc68b1c-aaea-44ef-800f-0c1daac97fa1 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Returning 404 to user: Instance d7f58550-4456-4d0f-b050-e0be7959139f could not be found. {{(pid=119306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:28:39.808614 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-adc68b1c-aaea-44ef-800f-0c1daac97fa1 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f" status: 404 len: 111 microversion: 2.1 time: 0.031634 Oct 26 11:28:39.808614 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 501/989] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Oct 26 11:28:39 2022] DELETE /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:28:39.813969 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-bca2340f-842b-4cff-aed5-e884d8e05be7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:39.814584 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-bca2340f-842b-4cff-aed5-e884d8e05be7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: d7f58550-4456-4d0f-b050-e0be7959139f] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:39.816513 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:28:39.822671 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bca2340f-842b-4cff-aed5-e884d8e05be7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:39.823207 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bca2340f-842b-4cff-aed5-e884d8e05be7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:39.823642 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bca2340f-842b-4cff-aed5-e884d8e05be7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:39.824327 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bca2340f-842b-4cff-aed5-e884d8e05be7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:39.824784 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bca2340f-842b-4cff-aed5-e884d8e05be7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:39.825208 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-bca2340f-842b-4cff-aed5-e884d8e05be7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:39.838940 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.wsgi [None req-bca2340f-842b-4cff-aed5-e884d8e05be7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] HTTP exception thrown: Instance d7f58550-4456-4d0f-b050-e0be7959139f could not be found. Oct 26 11:28:39.840573 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-bca2340f-842b-4cff-aed5-e884d8e05be7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Request method failure captured: Oct 26 11:28:39.840573 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: request: GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f HTTP/1.1 Oct 26 11:28:39.840573 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept: application/json Oct 26 11:28:39.840573 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept-Encoding: identity Oct 26 11:28:39.840573 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Connection: close Oct 26 11:28:39.840573 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Length: 0 Oct 26 11:28:39.840573 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Type: application/json Oct 26 11:28:39.840573 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Host: 10.222.0.42 Oct 26 11:28:39.840573 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Openstack-System-Scope: None Oct 26 11:28:39.840573 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: User-Agent: python-urllib3/1.26.12 Oct 26 11:28:39.840573 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Auth-Token: gAAAAABjWRd0c_l4dNmZmsslzgq0Y1mw7cHb2LyArYA_xomuSGUALJJhwUTg-8wegSnjp12OMWl50wz-0CzDaxBHziSvRsAIfgm9nG8oyGTTyhi4gK_QpH-0WiSM5GZmswPu8j2lHFCwK-c7q-bBx1gr_dj9FZxEy_m8cDa2tIsj3jWPztpcm3k Oct 26 11:28:39.840573 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Id: None Oct 26 11:28:39.840573 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Name: None Oct 26 11:28:39.840573 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Identity-Status: Confirmed Oct 26 11:28:39.840573 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Is-Admin-Project: True Oct 26 11:28:39.840573 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Id: default Oct 26 11:28:39.840573 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Name: Default Oct 26 11:28:39.840573 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Id: 724121c2144843b7adc7e17312613c9d Oct 26 11:28:39.840573 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:28:39.840573 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Role: member,reader Oct 26 11:28:39.840573 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Roles: member,reader Oct 26 11:28:39.842116 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_724121c2144843b7adc7e17312613c9d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724121c2144843b7adc7e17312613c9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/724121c2144843b7adc7e17312613c9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724121c2144843b7adc7e17312613c9d"}]}] Oct 26 11:28:39.842116 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:28:39.842116 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Id: 724121c2144843b7adc7e17312613c9d Oct 26 11:28:39.842116 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:28:39.842116 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User: tempest-AttachVolumeNegativeTest-1560590927-project Oct 26 11:28:39.842116 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Id: default Oct 26 11:28:39.842116 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Name: Default Oct 26 11:28:39.842116 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Id: e031dd9da25146eebb8813dc8bad8b85 Oct 26 11:28:39.842116 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Name: tempest-AttachVolumeNegativeTest-1560590927-project Oct 26 11:28:39.842116 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: method: > Oct 26 11:28:39.842116 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: exception: Instance d7f58550-4456-4d0f-b050-e0be7959139f could not be found. Oct 26 11:28:39.842116 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: action_args: {'id': 'd7f58550-4456-4d0f-b050-e0be7959139f'} Oct 26 11:28:39.843074 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:28:39.843074 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:39.843074 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:28:39.843074 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:28:39.843074 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:28:39.843074 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:28:39.843074 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:28:39.843074 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:28:39.843074 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:28:39.843074 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:28:39.843074 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7f58550-4456-4d0f-b050-e0be7959139f could not be found. Oct 26 11:28:39.843074 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:39.843074 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:39.843074 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:39.843074 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:39.843074 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:28:39.843074 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:28:39.843074 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:28:39.843074 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:28:39.843074 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:28:39.844524 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:28:39.844524 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 11:28:39.844524 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 11:28:39.844524 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:28:39.844524 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:28:39.844524 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:28:39.844524 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:28:39.844524 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7f58550-4456-4d0f-b050-e0be7959139f could not be found. Oct 26 11:28:39.844524 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:39.844524 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:39.844524 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:39.844524 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:39.844524 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:28:39.844524 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:28:39.844524 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:28:39.844524 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:28:39.844524 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7f58550-4456-4d0f-b050-e0be7959139f could not be found. Oct 26 11:28:39.844524 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:39.845830 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-bca2340f-842b-4cff-aed5-e884d8e05be7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Returning 404 to user: Instance d7f58550-4456-4d0f-b050-e0be7959139f could not be found. {{(pid=119305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:28:39.845830 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-bca2340f-842b-4cff-aed5-e884d8e05be7 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f" status: 404 len: 111 microversion: 2.1 time: 0.032285 Oct 26 11:28:39.845830 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 489/990] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:39 2022] GET /compute/v2.1/servers/d7f58550-4456-4d0f-b050-e0be7959139f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 11:28:41.085992 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-9e6c3f35-59a7-48de-a0bd-83361d8f1a02 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:41.086484 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-9e6c3f35-59a7-48de-a0bd-83361d8f1a02 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:41.093486 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9e6c3f35-59a7-48de-a0bd-83361d8f1a02 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:41.093967 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9e6c3f35-59a7-48de-a0bd-83361d8f1a02 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:41.094426 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9e6c3f35-59a7-48de-a0bd-83361d8f1a02 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:41.095132 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9e6c3f35-59a7-48de-a0bd-83361d8f1a02 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:41.095611 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9e6c3f35-59a7-48de-a0bd-83361d8f1a02 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:41.096026 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9e6c3f35-59a7-48de-a0bd-83361d8f1a02 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:41.109823 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.wsgi [None req-9e6c3f35-59a7-48de-a0bd-83361d8f1a02 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] HTTP exception thrown: Instance be2a7ec3-e66b-477d-99da-8d730066cf89 could not be found. Oct 26 11:28:41.111341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-9e6c3f35-59a7-48de-a0bd-83361d8f1a02 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Request method failure captured: Oct 26 11:28:41.111341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: request: DELETE /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89 HTTP/1.1 Oct 26 11:28:41.111341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept: application/json Oct 26 11:28:41.111341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept-Encoding: identity Oct 26 11:28:41.111341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Connection: close Oct 26 11:28:41.111341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Length: 0 Oct 26 11:28:41.111341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Type: application/json Oct 26 11:28:41.111341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Host: 10.222.0.42 Oct 26 11:28:41.111341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Openstack-System-Scope: None Oct 26 11:28:41.111341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: User-Agent: python-urllib3/1.26.12 Oct 26 11:28:41.111341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Auth-Token: gAAAAABjWRd0c_l4dNmZmsslzgq0Y1mw7cHb2LyArYA_xomuSGUALJJhwUTg-8wegSnjp12OMWl50wz-0CzDaxBHziSvRsAIfgm9nG8oyGTTyhi4gK_QpH-0WiSM5GZmswPu8j2lHFCwK-c7q-bBx1gr_dj9FZxEy_m8cDa2tIsj3jWPztpcm3k Oct 26 11:28:41.111341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Id: None Oct 26 11:28:41.111341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Name: None Oct 26 11:28:41.111341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Identity-Status: Confirmed Oct 26 11:28:41.111341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Is-Admin-Project: True Oct 26 11:28:41.111341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Id: default Oct 26 11:28:41.111341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Name: Default Oct 26 11:28:41.111341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Id: 724121c2144843b7adc7e17312613c9d Oct 26 11:28:41.111341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:28:41.111341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Role: member,reader Oct 26 11:28:41.111341 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Roles: member,reader Oct 26 11:28:41.113055 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_724121c2144843b7adc7e17312613c9d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724121c2144843b7adc7e17312613c9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/724121c2144843b7adc7e17312613c9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724121c2144843b7adc7e17312613c9d"}]}] Oct 26 11:28:41.113055 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:28:41.113055 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Id: 724121c2144843b7adc7e17312613c9d Oct 26 11:28:41.113055 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:28:41.113055 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User: tempest-AttachVolumeNegativeTest-1560590927-project Oct 26 11:28:41.113055 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Id: default Oct 26 11:28:41.113055 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Name: Default Oct 26 11:28:41.113055 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Id: e031dd9da25146eebb8813dc8bad8b85 Oct 26 11:28:41.113055 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Name: tempest-AttachVolumeNegativeTest-1560590927-project Oct 26 11:28:41.113055 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: method: > Oct 26 11:28:41.113055 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: exception: Instance be2a7ec3-e66b-477d-99da-8d730066cf89 could not be found. Oct 26 11:28:41.113055 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: action_args: {'id': 'be2a7ec3-e66b-477d-99da-8d730066cf89'} Oct 26 11:28:41.114038 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:28:41.114038 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:41.114038 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:28:41.114038 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:28:41.114038 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:28:41.114038 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:28:41.114038 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:28:41.114038 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:28:41.114038 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:28:41.114038 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:28:41.114038 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be2a7ec3-e66b-477d-99da-8d730066cf89 could not be found. Oct 26 11:28:41.114038 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:41.114038 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:41.114038 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:41.114038 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:41.114038 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:28:41.114038 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:28:41.114038 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:28:41.114038 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:28:41.114038 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:28:41.115610 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:28:41.115610 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 11:28:41.115610 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 11:28:41.115610 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 11:28:41.115610 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 11:28:41.115610 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:28:41.115610 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:28:41.115610 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:28:41.115610 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:28:41.115610 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be2a7ec3-e66b-477d-99da-8d730066cf89 could not be found. Oct 26 11:28:41.115610 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:41.115610 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:41.115610 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:41.115610 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:41.115610 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:28:41.115610 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:28:41.115610 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:28:41.115610 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:28:41.115610 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be2a7ec3-e66b-477d-99da-8d730066cf89 could not be found. Oct 26 11:28:41.115610 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:41.117094 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-9e6c3f35-59a7-48de-a0bd-83361d8f1a02 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Returning 404 to user: Instance be2a7ec3-e66b-477d-99da-8d730066cf89 could not be found. {{(pid=119306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:28:41.117094 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-9e6c3f35-59a7-48de-a0bd-83361d8f1a02 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "DELETE /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89" status: 404 len: 111 microversion: 2.1 time: 0.030690 Oct 26 11:28:41.117094 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 502/991] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Oct 26 11:28:41 2022] DELETE /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:28:41.121341 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-20f48beb-0afd-40a7-95c8-14daf4d8cf7a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:41.121950 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-20f48beb-0afd-40a7-95c8-14daf4d8cf7a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: be2a7ec3-e66b-477d-99da-8d730066cf89] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:41.128466 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-20f48beb-0afd-40a7-95c8-14daf4d8cf7a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:41.128943 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-20f48beb-0afd-40a7-95c8-14daf4d8cf7a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:41.129376 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-20f48beb-0afd-40a7-95c8-14daf4d8cf7a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:41.130097 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-20f48beb-0afd-40a7-95c8-14daf4d8cf7a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:41.130544 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-20f48beb-0afd-40a7-95c8-14daf4d8cf7a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:41.131001 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-20f48beb-0afd-40a7-95c8-14daf4d8cf7a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:41.144036 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.wsgi [None req-20f48beb-0afd-40a7-95c8-14daf4d8cf7a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] HTTP exception thrown: Instance be2a7ec3-e66b-477d-99da-8d730066cf89 could not be found. Oct 26 11:28:41.145514 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-20f48beb-0afd-40a7-95c8-14daf4d8cf7a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Request method failure captured: Oct 26 11:28:41.145514 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: request: GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89 HTTP/1.1 Oct 26 11:28:41.145514 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept: application/json Oct 26 11:28:41.145514 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept-Encoding: identity Oct 26 11:28:41.145514 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Connection: close Oct 26 11:28:41.145514 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Length: 0 Oct 26 11:28:41.145514 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Type: application/json Oct 26 11:28:41.145514 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Host: 10.222.0.42 Oct 26 11:28:41.145514 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Openstack-System-Scope: None Oct 26 11:28:41.145514 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: User-Agent: python-urllib3/1.26.12 Oct 26 11:28:41.145514 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Auth-Token: gAAAAABjWRd0c_l4dNmZmsslzgq0Y1mw7cHb2LyArYA_xomuSGUALJJhwUTg-8wegSnjp12OMWl50wz-0CzDaxBHziSvRsAIfgm9nG8oyGTTyhi4gK_QpH-0WiSM5GZmswPu8j2lHFCwK-c7q-bBx1gr_dj9FZxEy_m8cDa2tIsj3jWPztpcm3k Oct 26 11:28:41.145514 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Id: None Oct 26 11:28:41.145514 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Name: None Oct 26 11:28:41.145514 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Identity-Status: Confirmed Oct 26 11:28:41.145514 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Is-Admin-Project: True Oct 26 11:28:41.145514 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Id: default Oct 26 11:28:41.145514 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Name: Default Oct 26 11:28:41.145514 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Id: 724121c2144843b7adc7e17312613c9d Oct 26 11:28:41.145514 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:28:41.145514 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Role: member,reader Oct 26 11:28:41.145514 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Roles: member,reader Oct 26 11:28:41.147186 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_724121c2144843b7adc7e17312613c9d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724121c2144843b7adc7e17312613c9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/724121c2144843b7adc7e17312613c9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724121c2144843b7adc7e17312613c9d"}]}] Oct 26 11:28:41.147186 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:28:41.147186 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Id: 724121c2144843b7adc7e17312613c9d Oct 26 11:28:41.147186 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:28:41.147186 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User: tempest-AttachVolumeNegativeTest-1560590927-project Oct 26 11:28:41.147186 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Id: default Oct 26 11:28:41.147186 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Name: Default Oct 26 11:28:41.147186 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Id: e031dd9da25146eebb8813dc8bad8b85 Oct 26 11:28:41.147186 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Name: tempest-AttachVolumeNegativeTest-1560590927-project Oct 26 11:28:41.147186 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: method: > Oct 26 11:28:41.147186 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: exception: Instance be2a7ec3-e66b-477d-99da-8d730066cf89 could not be found. Oct 26 11:28:41.147186 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: action_args: {'id': 'be2a7ec3-e66b-477d-99da-8d730066cf89'} Oct 26 11:28:41.148479 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:28:41.148479 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:41.148479 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:28:41.148479 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:28:41.148479 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:28:41.148479 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:28:41.148479 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:28:41.148479 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:28:41.148479 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:28:41.148479 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:28:41.148479 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be2a7ec3-e66b-477d-99da-8d730066cf89 could not be found. Oct 26 11:28:41.148479 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:41.148479 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:41.148479 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:41.148479 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:41.148479 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:28:41.148479 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:28:41.148479 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:28:41.148479 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:28:41.148479 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:28:41.150449 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:28:41.150449 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 11:28:41.150449 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 11:28:41.150449 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:28:41.150449 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:28:41.150449 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:28:41.150449 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:28:41.150449 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be2a7ec3-e66b-477d-99da-8d730066cf89 could not be found. Oct 26 11:28:41.150449 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:41.150449 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:41.150449 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:41.150449 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:41.150449 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:28:41.150449 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:28:41.150449 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:28:41.150449 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:28:41.150449 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be2a7ec3-e66b-477d-99da-8d730066cf89 could not be found. Oct 26 11:28:41.150449 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:41.151860 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-20f48beb-0afd-40a7-95c8-14daf4d8cf7a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Returning 404 to user: Instance be2a7ec3-e66b-477d-99da-8d730066cf89 could not be found. {{(pid=119305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:28:41.151860 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-20f48beb-0afd-40a7-95c8-14daf4d8cf7a tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89" status: 404 len: 111 microversion: 2.1 time: 0.029717 Oct 26 11:28:41.151860 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 490/992] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:41 2022] GET /compute/v2.1/servers/be2a7ec3-e66b-477d-99da-8d730066cf89 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:28:41.156045 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-b33c3565-8e49-46fe-9f5e-71a73b99ea21 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:41.156541 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-b33c3565-8e49-46fe-9f5e-71a73b99ea21 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: a45dcfbe-3437-4feb-a827-dcfc141a24f9] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:41.162307 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b33c3565-8e49-46fe-9f5e-71a73b99ea21 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:41.162788 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b33c3565-8e49-46fe-9f5e-71a73b99ea21 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:41.163325 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b33c3565-8e49-46fe-9f5e-71a73b99ea21 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:41.164020 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b33c3565-8e49-46fe-9f5e-71a73b99ea21 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:41.164478 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b33c3565-8e49-46fe-9f5e-71a73b99ea21 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:41.165527 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b33c3565-8e49-46fe-9f5e-71a73b99ea21 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:41.180476 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.wsgi [None req-b33c3565-8e49-46fe-9f5e-71a73b99ea21 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] HTTP exception thrown: Instance a45dcfbe-3437-4feb-a827-dcfc141a24f9 could not be found. Oct 26 11:28:41.182009 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-b33c3565-8e49-46fe-9f5e-71a73b99ea21 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Request method failure captured: Oct 26 11:28:41.182009 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: request: DELETE /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9 HTTP/1.1 Oct 26 11:28:41.182009 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept: application/json Oct 26 11:28:41.182009 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept-Encoding: identity Oct 26 11:28:41.182009 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Connection: close Oct 26 11:28:41.182009 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Length: 0 Oct 26 11:28:41.182009 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Type: application/json Oct 26 11:28:41.182009 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Host: 10.222.0.42 Oct 26 11:28:41.182009 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Openstack-System-Scope: None Oct 26 11:28:41.182009 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: User-Agent: python-urllib3/1.26.12 Oct 26 11:28:41.182009 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Auth-Token: gAAAAABjWRd0c_l4dNmZmsslzgq0Y1mw7cHb2LyArYA_xomuSGUALJJhwUTg-8wegSnjp12OMWl50wz-0CzDaxBHziSvRsAIfgm9nG8oyGTTyhi4gK_QpH-0WiSM5GZmswPu8j2lHFCwK-c7q-bBx1gr_dj9FZxEy_m8cDa2tIsj3jWPztpcm3k Oct 26 11:28:41.182009 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Id: None Oct 26 11:28:41.182009 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Name: None Oct 26 11:28:41.182009 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Identity-Status: Confirmed Oct 26 11:28:41.182009 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Is-Admin-Project: True Oct 26 11:28:41.182009 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Id: default Oct 26 11:28:41.182009 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Name: Default Oct 26 11:28:41.182009 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Id: 724121c2144843b7adc7e17312613c9d Oct 26 11:28:41.182009 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:28:41.182009 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Role: member,reader Oct 26 11:28:41.182009 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Roles: member,reader Oct 26 11:28:41.183554 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_724121c2144843b7adc7e17312613c9d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724121c2144843b7adc7e17312613c9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/724121c2144843b7adc7e17312613c9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724121c2144843b7adc7e17312613c9d"}]}] Oct 26 11:28:41.183554 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:28:41.183554 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Id: 724121c2144843b7adc7e17312613c9d Oct 26 11:28:41.183554 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:28:41.183554 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User: tempest-AttachVolumeNegativeTest-1560590927-project Oct 26 11:28:41.183554 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Id: default Oct 26 11:28:41.183554 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Name: Default Oct 26 11:28:41.183554 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Id: e031dd9da25146eebb8813dc8bad8b85 Oct 26 11:28:41.183554 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Name: tempest-AttachVolumeNegativeTest-1560590927-project Oct 26 11:28:41.183554 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: method: > Oct 26 11:28:41.183554 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: exception: Instance a45dcfbe-3437-4feb-a827-dcfc141a24f9 could not be found. Oct 26 11:28:41.183554 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: action_args: {'id': 'a45dcfbe-3437-4feb-a827-dcfc141a24f9'} Oct 26 11:28:41.184579 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:28:41.184579 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:41.184579 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:28:41.184579 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:28:41.184579 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:28:41.184579 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:28:41.184579 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:28:41.184579 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:28:41.184579 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:28:41.184579 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:28:41.184579 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a45dcfbe-3437-4feb-a827-dcfc141a24f9 could not be found. Oct 26 11:28:41.184579 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:41.184579 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:41.184579 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:41.184579 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:41.184579 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:28:41.184579 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:28:41.184579 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:28:41.184579 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:28:41.184579 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:28:41.186043 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:28:41.186043 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 11:28:41.186043 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 11:28:41.186043 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 11:28:41.186043 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 11:28:41.186043 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:28:41.186043 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:28:41.186043 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:28:41.186043 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:28:41.186043 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a45dcfbe-3437-4feb-a827-dcfc141a24f9 could not be found. Oct 26 11:28:41.186043 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:41.186043 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:41.186043 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:41.186043 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:41.186043 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:28:41.186043 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:28:41.186043 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:28:41.186043 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:28:41.186043 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a45dcfbe-3437-4feb-a827-dcfc141a24f9 could not be found. Oct 26 11:28:41.186043 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:41.187567 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-b33c3565-8e49-46fe-9f5e-71a73b99ea21 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Returning 404 to user: Instance a45dcfbe-3437-4feb-a827-dcfc141a24f9 could not be found. {{(pid=119306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:28:41.187567 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-b33c3565-8e49-46fe-9f5e-71a73b99ea21 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9" status: 404 len: 111 microversion: 2.1 time: 0.031238 Oct 26 11:28:41.187567 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 503/993] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Oct 26 11:28:41 2022] DELETE /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:28:41.191841 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-deee7c70-b8e5-4b81-a238-780bcf8d5894 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:41.192456 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-deee7c70-b8e5-4b81-a238-780bcf8d5894 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: a45dcfbe-3437-4feb-a827-dcfc141a24f9] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:41.199138 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-deee7c70-b8e5-4b81-a238-780bcf8d5894 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:41.199629 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-deee7c70-b8e5-4b81-a238-780bcf8d5894 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:41.200097 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-deee7c70-b8e5-4b81-a238-780bcf8d5894 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:41.200794 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-deee7c70-b8e5-4b81-a238-780bcf8d5894 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:41.201254 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-deee7c70-b8e5-4b81-a238-780bcf8d5894 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:41.201706 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-deee7c70-b8e5-4b81-a238-780bcf8d5894 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:41.215607 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.wsgi [None req-deee7c70-b8e5-4b81-a238-780bcf8d5894 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] HTTP exception thrown: Instance a45dcfbe-3437-4feb-a827-dcfc141a24f9 could not be found. Oct 26 11:28:41.217104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-deee7c70-b8e5-4b81-a238-780bcf8d5894 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Request method failure captured: Oct 26 11:28:41.217104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: request: GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9 HTTP/1.1 Oct 26 11:28:41.217104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept: application/json Oct 26 11:28:41.217104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept-Encoding: identity Oct 26 11:28:41.217104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Connection: close Oct 26 11:28:41.217104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Length: 0 Oct 26 11:28:41.217104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Type: application/json Oct 26 11:28:41.217104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Host: 10.222.0.42 Oct 26 11:28:41.217104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Openstack-System-Scope: None Oct 26 11:28:41.217104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: User-Agent: python-urllib3/1.26.12 Oct 26 11:28:41.217104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Auth-Token: gAAAAABjWRd0c_l4dNmZmsslzgq0Y1mw7cHb2LyArYA_xomuSGUALJJhwUTg-8wegSnjp12OMWl50wz-0CzDaxBHziSvRsAIfgm9nG8oyGTTyhi4gK_QpH-0WiSM5GZmswPu8j2lHFCwK-c7q-bBx1gr_dj9FZxEy_m8cDa2tIsj3jWPztpcm3k Oct 26 11:28:41.217104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Id: None Oct 26 11:28:41.217104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Name: None Oct 26 11:28:41.217104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Identity-Status: Confirmed Oct 26 11:28:41.217104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Is-Admin-Project: True Oct 26 11:28:41.217104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Id: default Oct 26 11:28:41.217104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Name: Default Oct 26 11:28:41.217104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Id: 724121c2144843b7adc7e17312613c9d Oct 26 11:28:41.217104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:28:41.217104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Role: member,reader Oct 26 11:28:41.217104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Roles: member,reader Oct 26 11:28:41.218632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_724121c2144843b7adc7e17312613c9d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724121c2144843b7adc7e17312613c9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/724121c2144843b7adc7e17312613c9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724121c2144843b7adc7e17312613c9d"}]}] Oct 26 11:28:41.218632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:28:41.218632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Id: 724121c2144843b7adc7e17312613c9d Oct 26 11:28:41.218632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:28:41.218632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User: tempest-AttachVolumeNegativeTest-1560590927-project Oct 26 11:28:41.218632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Id: default Oct 26 11:28:41.218632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Name: Default Oct 26 11:28:41.218632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Id: e031dd9da25146eebb8813dc8bad8b85 Oct 26 11:28:41.218632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Name: tempest-AttachVolumeNegativeTest-1560590927-project Oct 26 11:28:41.218632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: method: > Oct 26 11:28:41.218632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: exception: Instance a45dcfbe-3437-4feb-a827-dcfc141a24f9 could not be found. Oct 26 11:28:41.218632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: action_args: {'id': 'a45dcfbe-3437-4feb-a827-dcfc141a24f9'} Oct 26 11:28:41.219729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:28:41.219729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:41.219729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:28:41.219729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:28:41.219729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:28:41.219729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:28:41.219729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:28:41.219729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:28:41.219729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:28:41.219729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:28:41.219729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a45dcfbe-3437-4feb-a827-dcfc141a24f9 could not be found. Oct 26 11:28:41.219729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:41.219729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:41.219729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:41.219729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:41.219729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:28:41.219729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:28:41.219729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:28:41.219729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:28:41.219729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:28:41.221167 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:28:41.221167 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 11:28:41.221167 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 11:28:41.221167 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:28:41.221167 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:28:41.221167 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:28:41.221167 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:28:41.221167 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a45dcfbe-3437-4feb-a827-dcfc141a24f9 could not be found. Oct 26 11:28:41.221167 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:41.221167 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:41.221167 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:41.221167 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:41.221167 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:28:41.221167 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:28:41.221167 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:28:41.221167 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:28:41.221167 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a45dcfbe-3437-4feb-a827-dcfc141a24f9 could not be found. Oct 26 11:28:41.221167 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:41.222669 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-deee7c70-b8e5-4b81-a238-780bcf8d5894 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Returning 404 to user: Instance a45dcfbe-3437-4feb-a827-dcfc141a24f9 could not be found. {{(pid=119305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:28:41.222669 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-deee7c70-b8e5-4b81-a238-780bcf8d5894 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9" status: 404 len: 111 microversion: 2.1 time: 0.030751 Oct 26 11:28:41.222669 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 491/994] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:41 2022] GET /compute/v2.1/servers/a45dcfbe-3437-4feb-a827-dcfc141a24f9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:28:42.498145 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-9ce1d089-e133-4a11-980a-0051df986683 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:42.498649 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-9ce1d089-e133-4a11-980a-0051df986683 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:42.500520 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell0:SELECT=2 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:28:42.505670 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9ce1d089-e133-4a11-980a-0051df986683 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:42.506147 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9ce1d089-e133-4a11-980a-0051df986683 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:42.506583 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9ce1d089-e133-4a11-980a-0051df986683 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:42.507304 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9ce1d089-e133-4a11-980a-0051df986683 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:42.507754 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9ce1d089-e133-4a11-980a-0051df986683 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:42.508173 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9ce1d089-e133-4a11-980a-0051df986683 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:42.521335 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.wsgi [None req-9ce1d089-e133-4a11-980a-0051df986683 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] HTTP exception thrown: Instance 5c038aa8-5351-4f13-8fc5-32674a0f6dce could not be found. Oct 26 11:28:42.523130 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-9ce1d089-e133-4a11-980a-0051df986683 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Request method failure captured: Oct 26 11:28:42.523130 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: request: DELETE /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce HTTP/1.1 Oct 26 11:28:42.523130 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept: application/json Oct 26 11:28:42.523130 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept-Encoding: identity Oct 26 11:28:42.523130 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Connection: close Oct 26 11:28:42.523130 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Length: 0 Oct 26 11:28:42.523130 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Type: application/json Oct 26 11:28:42.523130 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Host: 10.222.0.42 Oct 26 11:28:42.523130 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Openstack-System-Scope: None Oct 26 11:28:42.523130 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: User-Agent: python-urllib3/1.26.12 Oct 26 11:28:42.523130 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Auth-Token: gAAAAABjWRd0c_l4dNmZmsslzgq0Y1mw7cHb2LyArYA_xomuSGUALJJhwUTg-8wegSnjp12OMWl50wz-0CzDaxBHziSvRsAIfgm9nG8oyGTTyhi4gK_QpH-0WiSM5GZmswPu8j2lHFCwK-c7q-bBx1gr_dj9FZxEy_m8cDa2tIsj3jWPztpcm3k Oct 26 11:28:42.523130 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Id: None Oct 26 11:28:42.523130 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Name: None Oct 26 11:28:42.523130 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Identity-Status: Confirmed Oct 26 11:28:42.523130 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Is-Admin-Project: True Oct 26 11:28:42.523130 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Id: default Oct 26 11:28:42.523130 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Name: Default Oct 26 11:28:42.523130 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Id: 724121c2144843b7adc7e17312613c9d Oct 26 11:28:42.523130 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:28:42.523130 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Role: member,reader Oct 26 11:28:42.523130 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Roles: member,reader Oct 26 11:28:42.530154 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_724121c2144843b7adc7e17312613c9d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724121c2144843b7adc7e17312613c9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/724121c2144843b7adc7e17312613c9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724121c2144843b7adc7e17312613c9d"}]}] Oct 26 11:28:42.530154 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:28:42.530154 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Id: 724121c2144843b7adc7e17312613c9d Oct 26 11:28:42.530154 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:28:42.530154 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User: tempest-AttachVolumeNegativeTest-1560590927-project Oct 26 11:28:42.530154 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Id: default Oct 26 11:28:42.530154 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Name: Default Oct 26 11:28:42.530154 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Id: e031dd9da25146eebb8813dc8bad8b85 Oct 26 11:28:42.530154 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Name: tempest-AttachVolumeNegativeTest-1560590927-project Oct 26 11:28:42.530154 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: method: > Oct 26 11:28:42.530154 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: exception: Instance 5c038aa8-5351-4f13-8fc5-32674a0f6dce could not be found. Oct 26 11:28:42.530154 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: action_args: {'id': '5c038aa8-5351-4f13-8fc5-32674a0f6dce'} Oct 26 11:28:42.530978 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:28:42.530978 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:42.530978 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:28:42.530978 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:28:42.530978 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:28:42.530978 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:28:42.530978 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:28:42.530978 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:28:42.530978 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:28:42.530978 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:28:42.530978 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c038aa8-5351-4f13-8fc5-32674a0f6dce could not be found. Oct 26 11:28:42.530978 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:42.530978 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:42.530978 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:42.530978 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:42.530978 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:28:42.530978 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:28:42.530978 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:28:42.530978 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:28:42.530978 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:28:42.532273 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:28:42.532273 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 11:28:42.532273 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 11:28:42.532273 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 11:28:42.532273 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 11:28:42.532273 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:28:42.532273 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:28:42.532273 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:28:42.532273 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:28:42.532273 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c038aa8-5351-4f13-8fc5-32674a0f6dce could not be found. Oct 26 11:28:42.532273 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:42.532273 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:42.532273 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:42.532273 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:42.532273 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:28:42.532273 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:28:42.532273 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:28:42.532273 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:28:42.532273 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c038aa8-5351-4f13-8fc5-32674a0f6dce could not be found. Oct 26 11:28:42.532273 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:42.533539 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-9ce1d089-e133-4a11-980a-0051df986683 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Returning 404 to user: Instance 5c038aa8-5351-4f13-8fc5-32674a0f6dce could not be found. {{(pid=119306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:28:42.533539 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-9ce1d089-e133-4a11-980a-0051df986683 tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 404 len: 111 microversion: 2.1 time: 0.030280 Oct 26 11:28:42.533539 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 504/995] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Oct 26 11:28:42 2022] DELETE /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:28:42.533916 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-b85308e5-06ea-40b4-8432-059dbac0af8b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:42.534629 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-b85308e5-06ea-40b4-8432-059dbac0af8b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] [instance: 5c038aa8-5351-4f13-8fc5-32674a0f6dce] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:42.541974 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b85308e5-06ea-40b4-8432-059dbac0af8b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:42.542520 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b85308e5-06ea-40b4-8432-059dbac0af8b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:42.542986 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b85308e5-06ea-40b4-8432-059dbac0af8b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:42.543683 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b85308e5-06ea-40b4-8432-059dbac0af8b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:42.544139 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b85308e5-06ea-40b4-8432-059dbac0af8b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:42.544565 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b85308e5-06ea-40b4-8432-059dbac0af8b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:42.557723 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.wsgi [None req-b85308e5-06ea-40b4-8432-059dbac0af8b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] HTTP exception thrown: Instance 5c038aa8-5351-4f13-8fc5-32674a0f6dce could not be found. Oct 26 11:28:42.559256 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-b85308e5-06ea-40b4-8432-059dbac0af8b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Request method failure captured: Oct 26 11:28:42.559256 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: request: GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce HTTP/1.1 Oct 26 11:28:42.559256 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept: application/json Oct 26 11:28:42.559256 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept-Encoding: identity Oct 26 11:28:42.559256 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Connection: close Oct 26 11:28:42.559256 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Length: 0 Oct 26 11:28:42.559256 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Type: application/json Oct 26 11:28:42.559256 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Host: 10.222.0.42 Oct 26 11:28:42.559256 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Openstack-System-Scope: None Oct 26 11:28:42.559256 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: User-Agent: python-urllib3/1.26.12 Oct 26 11:28:42.559256 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Auth-Token: gAAAAABjWRd0c_l4dNmZmsslzgq0Y1mw7cHb2LyArYA_xomuSGUALJJhwUTg-8wegSnjp12OMWl50wz-0CzDaxBHziSvRsAIfgm9nG8oyGTTyhi4gK_QpH-0WiSM5GZmswPu8j2lHFCwK-c7q-bBx1gr_dj9FZxEy_m8cDa2tIsj3jWPztpcm3k Oct 26 11:28:42.559256 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Id: None Oct 26 11:28:42.559256 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Name: None Oct 26 11:28:42.559256 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Identity-Status: Confirmed Oct 26 11:28:42.559256 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Is-Admin-Project: True Oct 26 11:28:42.559256 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Id: default Oct 26 11:28:42.559256 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Name: Default Oct 26 11:28:42.559256 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Id: 724121c2144843b7adc7e17312613c9d Oct 26 11:28:42.559256 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:28:42.559256 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Role: member,reader Oct 26 11:28:42.559256 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Roles: member,reader Oct 26 11:28:42.560833 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_724121c2144843b7adc7e17312613c9d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724121c2144843b7adc7e17312613c9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/724121c2144843b7adc7e17312613c9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/724121c2144843b7adc7e17312613c9d"}]}] Oct 26 11:28:42.560833 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:28:42.560833 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Id: 724121c2144843b7adc7e17312613c9d Oct 26 11:28:42.560833 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560590927 Oct 26 11:28:42.560833 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User: tempest-AttachVolumeNegativeTest-1560590927-project Oct 26 11:28:42.560833 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Id: default Oct 26 11:28:42.560833 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Name: Default Oct 26 11:28:42.560833 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Id: e031dd9da25146eebb8813dc8bad8b85 Oct 26 11:28:42.560833 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Name: tempest-AttachVolumeNegativeTest-1560590927-project Oct 26 11:28:42.560833 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: method: > Oct 26 11:28:42.560833 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: exception: Instance 5c038aa8-5351-4f13-8fc5-32674a0f6dce could not be found. Oct 26 11:28:42.560833 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: action_args: {'id': '5c038aa8-5351-4f13-8fc5-32674a0f6dce'} Oct 26 11:28:42.561690 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:28:42.561690 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:42.561690 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:28:42.561690 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:28:42.561690 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:28:42.561690 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:28:42.561690 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:28:42.561690 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:28:42.561690 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:28:42.561690 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:28:42.561690 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c038aa8-5351-4f13-8fc5-32674a0f6dce could not be found. Oct 26 11:28:42.561690 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:42.561690 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:42.561690 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:42.561690 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:42.561690 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:28:42.561690 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:28:42.561690 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:28:42.561690 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:28:42.561690 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:28:42.562942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:28:42.562942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 11:28:42.562942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 11:28:42.562942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:28:42.562942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:28:42.562942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:28:42.562942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:28:42.562942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c038aa8-5351-4f13-8fc5-32674a0f6dce could not be found. Oct 26 11:28:42.562942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:42.562942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:42.562942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:42.562942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:42.562942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:28:42.562942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:28:42.562942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:28:42.562942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:28:42.562942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c038aa8-5351-4f13-8fc5-32674a0f6dce could not be found. Oct 26 11:28:42.562942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:42.564079 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-b85308e5-06ea-40b4-8432-059dbac0af8b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] Returning 404 to user: Instance 5c038aa8-5351-4f13-8fc5-32674a0f6dce could not be found. {{(pid=119305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:28:42.564079 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-b85308e5-06ea-40b4-8432-059dbac0af8b tempest-AttachVolumeNegativeTest-1560590927 tempest-AttachVolumeNegativeTest-1560590927-project] 10.222.0.42 "GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce" status: 404 len: 111 microversion: 2.1 time: 0.031001 Oct 26 11:28:42.564079 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 492/996] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:42 2022] GET /compute/v2.1/servers/5c038aa8-5351-4f13-8fc5-32674a0f6dce => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 11:28:44.122534 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-524be18b-092a-4280-b6a9-10e56c907231 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:44.124338 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-524be18b-092a-4280-b6a9-10e56c907231 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:44.137366 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-524be18b-092a-4280-b6a9-10e56c907231 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:44.138067 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-524be18b-092a-4280-b6a9-10e56c907231 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:44.138670 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-524be18b-092a-4280-b6a9-10e56c907231 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:44.139574 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-524be18b-092a-4280-b6a9-10e56c907231 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:44.140183 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-524be18b-092a-4280-b6a9-10e56c907231 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:44.140793 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-524be18b-092a-4280-b6a9-10e56c907231 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:44.299336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-524be18b-092a-4280-b6a9-10e56c907231 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:44.306246 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-524be18b-092a-4280-b6a9-10e56c907231 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1595 microversion: 2.1 time: 0.187780 Oct 26 11:28:44.307022 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 505/997] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:44 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1595 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:28:46.653042 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-fdc3df02-6125-4b81-a16e-4a377a742cd6 req-7c3a4368-93e7-4856-bef3-ffc0b20ff74f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbf3d5fd-8067-49a1-b4e3-51f5949018d5", "tag": "436d699c-83eb-4925-85b5-851f53994190"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:28:46.669185 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-fdc3df02-6125-4b81-a16e-4a377a742cd6 req-7c3a4368-93e7-4856-bef3-ffc0b20ff74f service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:46.670034 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-fdc3df02-6125-4b81-a16e-4a377a742cd6 req-7c3a4368-93e7-4856-bef3-ffc0b20ff74f service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:46.671124 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-fdc3df02-6125-4b81-a16e-4a377a742cd6 req-7c3a4368-93e7-4856-bef3-ffc0b20ff74f service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:46.685796 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-fdc3df02-6125-4b81-a16e-4a377a742cd6 req-7c3a4368-93e7-4856-bef3-ffc0b20ff74f service nova] Creating event network-changed:436d699c-83eb-4925-85b5-851f53994190 for instance cbf3d5fd-8067-49a1-b4e3-51f5949018d5 on hv-cinder-81558 Oct 26 11:28:46.691617 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-fdc3df02-6125-4b81-a16e-4a377a742cd6 req-7c3a4368-93e7-4856-bef3-ffc0b20ff74f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043251 Oct 26 11:28:46.692526 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 493/998] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:28:48.138328 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-0f48aa0f-c69c-477e-8053-387dbf7654cf tempest-VolumesNegativeTest-1174391636 tempest-VolumesNegativeTest-1174391636-project] Action: 'create', calling method: .version_select at 0x7f6b9363aee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-270545890", "metadata": {"Type": "work"}}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:28:48.145828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-0f48aa0f-c69c-477e-8053-387dbf7654cf tempest-VolumesNegativeTest-1174391636 tempest-VolumesNegativeTest-1174391636-project] Request method failure captured: Oct 26 11:28:48.145828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 26 11:28:48.145828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept: application/json Oct 26 11:28:48.145828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept-Encoding: identity Oct 26 11:28:48.145828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Connection: close Oct 26 11:28:48.145828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Length: 121 Oct 26 11:28:48.145828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Type: application/json Oct 26 11:28:48.145828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Host: 10.222.0.42 Oct 26 11:28:48.145828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Openstack-System-Scope: None Oct 26 11:28:48.145828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: User-Agent: python-urllib3/1.26.12 Oct 26 11:28:48.145828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Auth-Token: gAAAAABjWRnvXlFkMXEAuHAnMgJU708IOOtwyvN-LV6lq60mZJMHtiZq_OQ_k5kIt4g9vICXj_CFgZZTcP1gs8ATaSg-ewRmNfddoOO9N4MIQsqyKsRP9xD5S5FbJdR3oOfJate-c4-XMO2HLmX0nICxcoq_CieUjgLnie95btC0nz7atRB6JHc Oct 26 11:28:48.145828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Id: None Oct 26 11:28:48.145828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Name: None Oct 26 11:28:48.145828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Identity-Status: Confirmed Oct 26 11:28:48.145828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Is-Admin-Project: True Oct 26 11:28:48.145828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Id: default Oct 26 11:28:48.145828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Name: Default Oct 26 11:28:48.145828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Id: 127e058a793441948288b4b28144541f Oct 26 11:28:48.145828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Name: tempest-VolumesNegativeTest-1174391636 Oct 26 11:28:48.145828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Role: member,reader Oct 26 11:28:48.145828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Roles: member,reader Oct 26 11:28:48.147362 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_127e058a793441948288b4b28144541f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/127e058a793441948288b4b28144541f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/127e058a793441948288b4b28144541f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/127e058a793441948288b4b28144541f"}]}] Oct 26 11:28:48.147362 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant: tempest-VolumesNegativeTest-1174391636 Oct 26 11:28:48.147362 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Id: 127e058a793441948288b4b28144541f Oct 26 11:28:48.147362 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Name: tempest-VolumesNegativeTest-1174391636 Oct 26 11:28:48.147362 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User: tempest-VolumesNegativeTest-1174391636-project Oct 26 11:28:48.147362 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Id: default Oct 26 11:28:48.147362 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Name: Default Oct 26 11:28:48.147362 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Id: c2d487cb0b1444f7afb4004486ec7c42 Oct 26 11:28:48.147362 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Name: tempest-VolumesNegativeTest-1174391636-project Oct 26 11:28:48.147362 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Oct 26 11:28:48.147362 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-270545890", "metadata": {"Type": "work"}}} Oct 26 11:28:48.147362 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: method: Oct 26 11:28:48.147362 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 26 11:28:48.148589 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-270545890', 'metadata': {'Type': 'work'}}}} Oct 26 11:28:48.148589 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:28:48.148589 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:48.148589 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 11:28:48.148589 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 11:28:48.148589 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 11:28:48.148589 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise error Oct 26 11:28:48.148589 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 26 11:28:48.148589 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.148589 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 26 11:28:48.148589 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 26 11:28:48.148589 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.148589 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 26 11:28:48.148589 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi '#$%' Oct 26 11:28:48.148589 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.148589 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:48.148589 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.148589 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:48.148589 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:28:48.148589 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:28:48.148589 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:28:48.148589 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:28:48.149989 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 11:28:48.149989 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 11:28:48.149989 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:28:48.149989 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:28:48.149989 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 11:28:48.149989 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 11:28:48.149989 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 11:28:48.149989 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 11:28:48.149989 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 11:28:48.149989 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 11:28:48.149989 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 26 11:28:48.149989 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.149989 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:48.149989 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.149989 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:48.149989 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:28:48.149989 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:28:48.149989 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 11:28:48.149989 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 11:28:48.153331 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 26 11:28:48.153331 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.153331 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-0f48aa0f-c69c-477e-8053-387dbf7654cf tempest-VolumesNegativeTest-1174391636 tempest-VolumesNegativeTest-1174391636-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:28:48.153331 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-0f48aa0f-c69c-477e-8053-387dbf7654cf tempest-VolumesNegativeTest-1174391636 tempest-VolumesNegativeTest-1174391636-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.129981 Oct 26 11:28:48.153331 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 506/999] 10.222.0.42 () {60 vars in 1156 bytes} [Wed Oct 26 11:28:48 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 11:28:48.158723 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-1653e39c-4b7b-4624-a6fa-bb38537a9d04 tempest-VolumesNegativeTest-1174391636 tempest-VolumesNegativeTest-1174391636-project] Action: 'create', calling method: .version_select at 0x7f6b937afb80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-207715681", "metadata": {"Type": "work"}}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:28:48.163445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-1653e39c-4b7b-4624-a6fa-bb38537a9d04 tempest-VolumesNegativeTest-1174391636 tempest-VolumesNegativeTest-1174391636-project] Request method failure captured: Oct 26 11:28:48.163445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 26 11:28:48.163445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept: application/json Oct 26 11:28:48.163445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept-Encoding: identity Oct 26 11:28:48.163445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Connection: close Oct 26 11:28:48.163445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Length: 119 Oct 26 11:28:48.163445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Type: application/json Oct 26 11:28:48.163445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Host: 10.222.0.42 Oct 26 11:28:48.163445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Openstack-System-Scope: None Oct 26 11:28:48.163445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: User-Agent: python-urllib3/1.26.12 Oct 26 11:28:48.163445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Auth-Token: gAAAAABjWRnvXlFkMXEAuHAnMgJU708IOOtwyvN-LV6lq60mZJMHtiZq_OQ_k5kIt4g9vICXj_CFgZZTcP1gs8ATaSg-ewRmNfddoOO9N4MIQsqyKsRP9xD5S5FbJdR3oOfJate-c4-XMO2HLmX0nICxcoq_CieUjgLnie95btC0nz7atRB6JHc Oct 26 11:28:48.163445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Id: None Oct 26 11:28:48.163445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Name: None Oct 26 11:28:48.163445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Identity-Status: Confirmed Oct 26 11:28:48.163445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Is-Admin-Project: True Oct 26 11:28:48.163445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Id: default Oct 26 11:28:48.163445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Name: Default Oct 26 11:28:48.163445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Id: 127e058a793441948288b4b28144541f Oct 26 11:28:48.163445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Name: tempest-VolumesNegativeTest-1174391636 Oct 26 11:28:48.163445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Role: member,reader Oct 26 11:28:48.163445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Roles: member,reader Oct 26 11:28:48.170036 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_127e058a793441948288b4b28144541f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/127e058a793441948288b4b28144541f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/127e058a793441948288b4b28144541f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/127e058a793441948288b4b28144541f"}]}] Oct 26 11:28:48.170036 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant: tempest-VolumesNegativeTest-1174391636 Oct 26 11:28:48.170036 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Id: 127e058a793441948288b4b28144541f Oct 26 11:28:48.170036 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Name: tempest-VolumesNegativeTest-1174391636 Oct 26 11:28:48.170036 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User: tempest-VolumesNegativeTest-1174391636-project Oct 26 11:28:48.170036 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Id: default Oct 26 11:28:48.170036 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Name: Default Oct 26 11:28:48.170036 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Id: c2d487cb0b1444f7afb4004486ec7c42 Oct 26 11:28:48.170036 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Name: tempest-VolumesNegativeTest-1174391636-project Oct 26 11:28:48.170036 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Oct 26 11:28:48.170036 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-207715681", "metadata": {"Type": "work"}}} Oct 26 11:28:48.170036 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: method: Oct 26 11:28:48.170036 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 26 11:28:48.170989 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-207715681', 'metadata': {'Type': 'work'}}}} Oct 26 11:28:48.170989 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:28:48.170989 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:48.170989 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 11:28:48.170989 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 11:28:48.170989 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 11:28:48.170989 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise error Oct 26 11:28:48.170989 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 26 11:28:48.170989 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.170989 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 26 11:28:48.170989 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 26 11:28:48.170989 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.170989 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 26 11:28:48.170989 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi '0' Oct 26 11:28:48.170989 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.170989 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:48.170989 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.170989 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:48.170989 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:28:48.170989 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:28:48.170989 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:28:48.170989 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:28:48.172657 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 11:28:48.172657 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 11:28:48.172657 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:28:48.172657 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:28:48.172657 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 11:28:48.172657 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 11:28:48.172657 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 11:28:48.172657 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 11:28:48.172657 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 11:28:48.172657 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 11:28:48.172657 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 26 11:28:48.172657 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.172657 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:48.172657 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.172657 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:48.172657 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:28:48.172657 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:28:48.172657 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 11:28:48.172657 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 11:28:48.174014 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 26 11:28:48.174014 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.174014 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-1653e39c-4b7b-4624-a6fa-bb38537a9d04 tempest-VolumesNegativeTest-1174391636 tempest-VolumesNegativeTest-1174391636-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:28:48.174014 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-1653e39c-4b7b-4624-a6fa-bb38537a9d04 tempest-VolumesNegativeTest-1174391636 tempest-VolumesNegativeTest-1174391636-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010431 Oct 26 11:28:48.174014 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 494/1000] 10.222.0.42 () {60 vars in 1156 bytes} [Wed Oct 26 11:28:48 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 11:28:48.177079 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-81809d3a-54e0-4fe9-9a24-f9419eca3004 tempest-VolumesNegativeTest-1174391636 tempest-VolumesNegativeTest-1174391636-project] Action: 'create', calling method: .version_select at 0x7f6b937a6f70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-978912821", "metadata": {"Type": "work"}}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:28:48.180983 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-81809d3a-54e0-4fe9-9a24-f9419eca3004 tempest-VolumesNegativeTest-1174391636 tempest-VolumesNegativeTest-1174391636-project] Request method failure captured: Oct 26 11:28:48.180983 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 26 11:28:48.180983 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept: application/json Oct 26 11:28:48.180983 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept-Encoding: identity Oct 26 11:28:48.180983 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Connection: close Oct 26 11:28:48.180983 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Length: 118 Oct 26 11:28:48.180983 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Type: application/json Oct 26 11:28:48.180983 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Host: 10.222.0.42 Oct 26 11:28:48.180983 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Openstack-System-Scope: None Oct 26 11:28:48.180983 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: User-Agent: python-urllib3/1.26.12 Oct 26 11:28:48.180983 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Auth-Token: gAAAAABjWRnvXlFkMXEAuHAnMgJU708IOOtwyvN-LV6lq60mZJMHtiZq_OQ_k5kIt4g9vICXj_CFgZZTcP1gs8ATaSg-ewRmNfddoOO9N4MIQsqyKsRP9xD5S5FbJdR3oOfJate-c4-XMO2HLmX0nICxcoq_CieUjgLnie95btC0nz7atRB6JHc Oct 26 11:28:48.180983 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Id: None Oct 26 11:28:48.180983 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Name: None Oct 26 11:28:48.180983 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Identity-Status: Confirmed Oct 26 11:28:48.180983 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Is-Admin-Project: True Oct 26 11:28:48.180983 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Id: default Oct 26 11:28:48.180983 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Name: Default Oct 26 11:28:48.180983 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Id: 127e058a793441948288b4b28144541f Oct 26 11:28:48.180983 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Name: tempest-VolumesNegativeTest-1174391636 Oct 26 11:28:48.180983 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Role: member,reader Oct 26 11:28:48.180983 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Roles: member,reader Oct 26 11:28:48.182501 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_127e058a793441948288b4b28144541f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/127e058a793441948288b4b28144541f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/127e058a793441948288b4b28144541f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/127e058a793441948288b4b28144541f"}]}] Oct 26 11:28:48.182501 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant: tempest-VolumesNegativeTest-1174391636 Oct 26 11:28:48.182501 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Id: 127e058a793441948288b4b28144541f Oct 26 11:28:48.182501 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Name: tempest-VolumesNegativeTest-1174391636 Oct 26 11:28:48.182501 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User: tempest-VolumesNegativeTest-1174391636-project Oct 26 11:28:48.182501 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Id: default Oct 26 11:28:48.182501 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Name: Default Oct 26 11:28:48.182501 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Id: c2d487cb0b1444f7afb4004486ec7c42 Oct 26 11:28:48.182501 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Name: tempest-VolumesNegativeTest-1174391636-project Oct 26 11:28:48.182501 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Oct 26 11:28:48.182501 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-978912821", "metadata": {"Type": "work"}}} Oct 26 11:28:48.182501 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: method: Oct 26 11:28:48.182501 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 26 11:28:48.183535 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-978912821', 'metadata': {'Type': 'work'}}}} Oct 26 11:28:48.183535 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:28:48.183535 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:48.183535 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 26 11:28:48.183535 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 26 11:28:48.183535 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 26 11:28:48.183535 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise error Oct 26 11:28:48.183535 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 26 11:28:48.183535 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.183535 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 26 11:28:48.183535 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 26 11:28:48.183535 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.183535 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 26 11:28:48.183535 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi '' Oct 26 11:28:48.183535 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.183535 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:48.183535 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.183535 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:48.183535 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:28:48.183535 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:28:48.183535 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:28:48.183535 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:28:48.185061 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 11:28:48.185061 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 11:28:48.185061 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:28:48.185061 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:28:48.185061 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 26 11:28:48.185061 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 26 11:28:48.185061 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 26 11:28:48.185061 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 26 11:28:48.185061 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 26 11:28:48.185061 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 26 11:28:48.185061 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 26 11:28:48.185061 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.185061 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:48.185061 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.185061 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:48.185061 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:28:48.185061 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:28:48.185061 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 26 11:28:48.185061 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 26 11:28:48.186176 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 26 11:28:48.186176 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.186176 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-81809d3a-54e0-4fe9-9a24-f9419eca3004 tempest-VolumesNegativeTest-1174391636 tempest-VolumesNegativeTest-1174391636-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:28:48.186176 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-81809d3a-54e0-4fe9-9a24-f9419eca3004 tempest-VolumesNegativeTest-1174391636 tempest-VolumesNegativeTest-1174391636-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009297 Oct 26 11:28:48.186176 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 507/1001] 10.222.0.42 () {60 vars in 1156 bytes} [Wed Oct 26 11:28:48 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 26 11:28:48.191900 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a9c78dbd-9b15-4ead-b188-59b478faad4b tempest-VolumesNegativeTest-1174391636 tempest-VolumesNegativeTest-1174391636-project] Calling method '.version_select at 0x7f6b937d8d30>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:48.221330 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.wsgi [None req-a9c78dbd-9b15-4ead-b188-59b478faad4b tempest-VolumesNegativeTest-1174391636 tempest-VolumesNegativeTest-1174391636-project] HTTP exception thrown: Volume tempest-invalid-1001234952 could not be found. Oct 26 11:28:48.223335 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a9c78dbd-9b15-4ead-b188-59b478faad4b tempest-VolumesNegativeTest-1174391636 tempest-VolumesNegativeTest-1174391636-project] Request method failure captured: Oct 26 11:28:48.223335 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1001234952 HTTP/1.1 Oct 26 11:28:48.223335 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept: application/json Oct 26 11:28:48.223335 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept-Encoding: identity Oct 26 11:28:48.223335 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Connection: close Oct 26 11:28:48.223335 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Length: 0 Oct 26 11:28:48.223335 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Type: application/json Oct 26 11:28:48.223335 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Host: 10.222.0.42 Oct 26 11:28:48.223335 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Openstack-System-Scope: None Oct 26 11:28:48.223335 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: User-Agent: python-urllib3/1.26.12 Oct 26 11:28:48.223335 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Auth-Token: gAAAAABjWRnvXlFkMXEAuHAnMgJU708IOOtwyvN-LV6lq60mZJMHtiZq_OQ_k5kIt4g9vICXj_CFgZZTcP1gs8ATaSg-ewRmNfddoOO9N4MIQsqyKsRP9xD5S5FbJdR3oOfJate-c4-XMO2HLmX0nICxcoq_CieUjgLnie95btC0nz7atRB6JHc Oct 26 11:28:48.223335 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Id: None Oct 26 11:28:48.223335 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Name: None Oct 26 11:28:48.223335 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Identity-Status: Confirmed Oct 26 11:28:48.223335 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Is-Admin-Project: True Oct 26 11:28:48.223335 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Id: default Oct 26 11:28:48.223335 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Name: Default Oct 26 11:28:48.223335 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Id: 127e058a793441948288b4b28144541f Oct 26 11:28:48.223335 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Name: tempest-VolumesNegativeTest-1174391636 Oct 26 11:28:48.223335 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Role: member,reader Oct 26 11:28:48.223335 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Roles: member,reader Oct 26 11:28:48.224974 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_127e058a793441948288b4b28144541f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/127e058a793441948288b4b28144541f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/127e058a793441948288b4b28144541f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/127e058a793441948288b4b28144541f"}]}] Oct 26 11:28:48.224974 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant: tempest-VolumesNegativeTest-1174391636 Oct 26 11:28:48.224974 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Id: 127e058a793441948288b4b28144541f Oct 26 11:28:48.224974 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Name: tempest-VolumesNegativeTest-1174391636 Oct 26 11:28:48.224974 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User: tempest-VolumesNegativeTest-1174391636-project Oct 26 11:28:48.224974 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Id: default Oct 26 11:28:48.224974 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Name: Default Oct 26 11:28:48.224974 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Id: c2d487cb0b1444f7afb4004486ec7c42 Oct 26 11:28:48.224974 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Name: tempest-VolumesNegativeTest-1174391636-project Oct 26 11:28:48.224974 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: method: Oct 26 11:28:48.224974 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: exception: Volume tempest-invalid-1001234952 could not be found. Oct 26 11:28:48.224974 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: action_args: {'id': 'tempest-invalid-1001234952'} Oct 26 11:28:48.224974 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:28:48.225891 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:48.225891 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 11:28:48.225891 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 11:28:48.225891 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 26 11:28:48.225891 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 26 11:28:48.225891 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 26 11:28:48.225891 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 26 11:28:48.225891 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 26 11:28:48.225891 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 26 11:28:48.225891 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 26 11:28:48.225891 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 26 11:28:48.225891 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 11:28:48.225891 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 11:28:48.225891 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 11:28:48.225891 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 11:28:48.225891 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1001234952 could not be found. (HTTP 404) (Request-ID: req-ff183c9f-48e2-4c61-bc28-9ea786dd10b8) Oct 26 11:28:48.225891 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.225891 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:48.225891 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.227471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:48.227471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 26 11:28:48.227471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 26 11:28:48.227471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 26 11:28:48.227471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 26 11:28:48.227471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 26 11:28:48.227471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 26 11:28:48.227471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 26 11:28:48.227471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 26 11:28:48.227471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 11:28:48.227471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 11:28:48.227471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 26 11:28:48.227471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 26 11:28:48.227471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 26 11:28:48.227471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 26 11:28:48.227471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 26 11:28:48.227471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 26 11:28:48.227471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 26 11:28:48.227471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 26 11:28:48.228716 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 11:28:48.228716 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 11:28:48.228716 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 11:28:48.228716 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 11:28:48.228716 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1001234952 could not be found. Oct 26 11:28:48.228716 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.228716 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:48.228716 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.228716 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:48.228716 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:28:48.228716 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:28:48.228716 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:28:48.228716 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:28:48.228716 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 11:28:48.228716 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 11:28:48.228716 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:28:48.228716 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:28:48.228716 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 26 11:28:48.228716 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:28:48.228716 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1001234952 could not be found. Oct 26 11:28:48.230016 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.230016 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:48.230016 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.230016 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:48.230016 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:28:48.230016 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:28:48.230016 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:28:48.230016 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:28:48.230016 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1001234952 could not be found. Oct 26 11:28:48.230016 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.230016 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a9c78dbd-9b15-4ead-b188-59b478faad4b tempest-VolumesNegativeTest-1174391636 tempest-VolumesNegativeTest-1174391636-project] Returning 404 to user: Volume tempest-invalid-1001234952 could not be found. {{(pid=119305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:28:48.230016 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-a9c78dbd-9b15-4ead-b188-59b478faad4b tempest-VolumesNegativeTest-1174391636 tempest-VolumesNegativeTest-1174391636-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1001234952" status: 404 len: 99 microversion: 2.1 time: 0.037242 Oct 26 11:28:48.230016 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 495/1002] 10.222.0.42 () {58 vars in 1218 bytes} [Wed Oct 26 11:28:48 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1001234952 => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 26 11:28:48.236039 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-174362cf-f77b-4c76-a9e3-8714407c38b7 tempest-VolumesNegativeTest-1174391636 tempest-VolumesNegativeTest-1174391636-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003841 Oct 26 11:28:48.236536 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 508/1003] 10.222.0.42 () {58 vars in 1140 bytes} [Wed Oct 26 11:28:48 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 26 11:28:48.244717 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-5f251989-76e7-4d44-9bb7-5f0fe5b87855 tempest-VolumesNegativeTest-1174391636 tempest-VolumesNegativeTest-1174391636-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003739 Oct 26 11:28:48.245249 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 496/1004] 10.222.0.42 () {58 vars in 1137 bytes} [Wed Oct 26 11:28:48 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 26 11:28:48.256617 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-7a87d3f5-2068-47f9-804d-3ff1034607f6 tempest-VolumesNegativeTest-1174391636 tempest-VolumesNegativeTest-1174391636-project] Calling method '.version_select at 0x7f6b937dfb80>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:48.286048 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.wsgi [None req-7a87d3f5-2068-47f9-804d-3ff1034607f6 tempest-VolumesNegativeTest-1174391636 tempest-VolumesNegativeTest-1174391636-project] HTTP exception thrown: Volume ff6baf17-3521-4c39-a64a-b0c180136647 could not be found. Oct 26 11:28:48.288095 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-7a87d3f5-2068-47f9-804d-3ff1034607f6 tempest-VolumesNegativeTest-1174391636 tempest-VolumesNegativeTest-1174391636-project] Request method failure captured: Oct 26 11:28:48.288095 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: request: DELETE /compute/v2.1/os-volumes/ff6baf17-3521-4c39-a64a-b0c180136647 HTTP/1.1 Oct 26 11:28:48.288095 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept: application/json Oct 26 11:28:48.288095 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept-Encoding: identity Oct 26 11:28:48.288095 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Connection: close Oct 26 11:28:48.288095 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Length: 0 Oct 26 11:28:48.288095 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Type: application/json Oct 26 11:28:48.288095 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Host: 10.222.0.42 Oct 26 11:28:48.288095 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Openstack-System-Scope: None Oct 26 11:28:48.288095 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: User-Agent: python-urllib3/1.26.12 Oct 26 11:28:48.288095 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Auth-Token: gAAAAABjWRnvXlFkMXEAuHAnMgJU708IOOtwyvN-LV6lq60mZJMHtiZq_OQ_k5kIt4g9vICXj_CFgZZTcP1gs8ATaSg-ewRmNfddoOO9N4MIQsqyKsRP9xD5S5FbJdR3oOfJate-c4-XMO2HLmX0nICxcoq_CieUjgLnie95btC0nz7atRB6JHc Oct 26 11:28:48.288095 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Id: None Oct 26 11:28:48.288095 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Name: None Oct 26 11:28:48.288095 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Identity-Status: Confirmed Oct 26 11:28:48.288095 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Is-Admin-Project: True Oct 26 11:28:48.288095 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Id: default Oct 26 11:28:48.288095 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Name: Default Oct 26 11:28:48.288095 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Id: 127e058a793441948288b4b28144541f Oct 26 11:28:48.288095 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Name: tempest-VolumesNegativeTest-1174391636 Oct 26 11:28:48.288095 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Role: member,reader Oct 26 11:28:48.288095 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Roles: member,reader Oct 26 11:28:48.289654 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_127e058a793441948288b4b28144541f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/127e058a793441948288b4b28144541f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/127e058a793441948288b4b28144541f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/127e058a793441948288b4b28144541f"}]}] Oct 26 11:28:48.289654 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant: tempest-VolumesNegativeTest-1174391636 Oct 26 11:28:48.289654 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Id: 127e058a793441948288b4b28144541f Oct 26 11:28:48.289654 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Name: tempest-VolumesNegativeTest-1174391636 Oct 26 11:28:48.289654 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User: tempest-VolumesNegativeTest-1174391636-project Oct 26 11:28:48.289654 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Id: default Oct 26 11:28:48.289654 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Name: Default Oct 26 11:28:48.289654 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Id: c2d487cb0b1444f7afb4004486ec7c42 Oct 26 11:28:48.289654 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Name: tempest-VolumesNegativeTest-1174391636-project Oct 26 11:28:48.289654 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: method: Oct 26 11:28:48.289654 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: exception: Volume ff6baf17-3521-4c39-a64a-b0c180136647 could not be found. Oct 26 11:28:48.289654 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: action_args: {'id': 'ff6baf17-3521-4c39-a64a-b0c180136647'} Oct 26 11:28:48.289654 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:28:48.290549 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:48.290549 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 11:28:48.290549 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 11:28:48.290549 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 26 11:28:48.290549 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 26 11:28:48.290549 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 26 11:28:48.290549 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 26 11:28:48.290549 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 26 11:28:48.290549 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 26 11:28:48.290549 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 26 11:28:48.290549 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 26 11:28:48.290549 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 11:28:48.290549 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 11:28:48.290549 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 11:28:48.290549 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 11:28:48.290549 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ff6baf17-3521-4c39-a64a-b0c180136647 could not be found. (HTTP 404) (Request-ID: req-5bd5a694-9021-4616-aeff-39d0114a1530) Oct 26 11:28:48.290549 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.290549 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:48.290549 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.296563 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:48.296563 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 26 11:28:48.296563 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 26 11:28:48.296563 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 26 11:28:48.296563 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 26 11:28:48.296563 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 26 11:28:48.296563 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 26 11:28:48.296563 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 26 11:28:48.296563 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 26 11:28:48.296563 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 11:28:48.296563 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 11:28:48.296563 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 26 11:28:48.296563 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 26 11:28:48.296563 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 26 11:28:48.296563 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 26 11:28:48.296563 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 26 11:28:48.296563 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 26 11:28:48.296563 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 26 11:28:48.296563 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 26 11:28:48.297861 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 11:28:48.297861 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 11:28:48.297861 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 11:28:48.297861 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 11:28:48.297861 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ff6baf17-3521-4c39-a64a-b0c180136647 could not be found. Oct 26 11:28:48.297861 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.297861 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:48.297861 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.297861 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:48.297861 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:28:48.297861 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:28:48.297861 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:28:48.297861 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:28:48.297861 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 11:28:48.297861 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 11:28:48.297861 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:28:48.297861 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:28:48.297861 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 26 11:28:48.297861 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:28:48.299203 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ff6baf17-3521-4c39-a64a-b0c180136647 could not be found. Oct 26 11:28:48.299203 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.299203 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:48.299203 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.299203 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:48.299203 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:28:48.299203 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:28:48.299203 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:28:48.299203 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:28:48.299203 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ff6baf17-3521-4c39-a64a-b0c180136647 could not be found. Oct 26 11:28:48.299203 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.299203 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-7a87d3f5-2068-47f9-804d-3ff1034607f6 tempest-VolumesNegativeTest-1174391636 tempest-VolumesNegativeTest-1174391636-project] Returning 404 to user: Volume ff6baf17-3521-4c39-a64a-b0c180136647 could not be found. {{(pid=119306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:28:48.299203 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-7a87d3f5-2068-47f9-804d-3ff1034607f6 tempest-VolumesNegativeTest-1174391636 tempest-VolumesNegativeTest-1174391636-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/ff6baf17-3521-4c39-a64a-b0c180136647" status: 404 len: 109 microversion: 2.1 time: 0.036498 Oct 26 11:28:48.299203 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 509/1005] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Oct 26 11:28:48 2022] DELETE /compute/v2.1/os-volumes/ff6baf17-3521-4c39-a64a-b0c180136647 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:28:48.305607 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-6c8f5fe7-a32e-43f3-8de2-ced8180f61ba tempest-VolumesNegativeTest-1174391636 tempest-VolumesNegativeTest-1174391636-project] Calling method '.version_select at 0x7f6b9384f820>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:48.334665 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.wsgi [None req-6c8f5fe7-a32e-43f3-8de2-ced8180f61ba tempest-VolumesNegativeTest-1174391636 tempest-VolumesNegativeTest-1174391636-project] HTTP exception thrown: Volume 52362a29-5310-4dee-a848-e36465eb0c70 could not be found. Oct 26 11:28:48.336632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-6c8f5fe7-a32e-43f3-8de2-ced8180f61ba tempest-VolumesNegativeTest-1174391636 tempest-VolumesNegativeTest-1174391636-project] Request method failure captured: Oct 26 11:28:48.336632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: request: GET /compute/v2.1/os-volumes/52362a29-5310-4dee-a848-e36465eb0c70 HTTP/1.1 Oct 26 11:28:48.336632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept: application/json Oct 26 11:28:48.336632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept-Encoding: identity Oct 26 11:28:48.336632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Connection: close Oct 26 11:28:48.336632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Length: 0 Oct 26 11:28:48.336632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Type: application/json Oct 26 11:28:48.336632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Host: 10.222.0.42 Oct 26 11:28:48.336632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Openstack-System-Scope: None Oct 26 11:28:48.336632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: User-Agent: python-urllib3/1.26.12 Oct 26 11:28:48.336632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Auth-Token: gAAAAABjWRnvXlFkMXEAuHAnMgJU708IOOtwyvN-LV6lq60mZJMHtiZq_OQ_k5kIt4g9vICXj_CFgZZTcP1gs8ATaSg-ewRmNfddoOO9N4MIQsqyKsRP9xD5S5FbJdR3oOfJate-c4-XMO2HLmX0nICxcoq_CieUjgLnie95btC0nz7atRB6JHc Oct 26 11:28:48.336632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Id: None Oct 26 11:28:48.336632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Name: None Oct 26 11:28:48.336632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Identity-Status: Confirmed Oct 26 11:28:48.336632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Is-Admin-Project: True Oct 26 11:28:48.336632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Id: default Oct 26 11:28:48.336632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Name: Default Oct 26 11:28:48.336632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Id: 127e058a793441948288b4b28144541f Oct 26 11:28:48.336632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Name: tempest-VolumesNegativeTest-1174391636 Oct 26 11:28:48.336632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Role: member,reader Oct 26 11:28:48.336632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Roles: member,reader Oct 26 11:28:48.338245 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_127e058a793441948288b4b28144541f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/127e058a793441948288b4b28144541f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/127e058a793441948288b4b28144541f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/127e058a793441948288b4b28144541f"}]}] Oct 26 11:28:48.338245 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant: tempest-VolumesNegativeTest-1174391636 Oct 26 11:28:48.338245 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Id: 127e058a793441948288b4b28144541f Oct 26 11:28:48.338245 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Name: tempest-VolumesNegativeTest-1174391636 Oct 26 11:28:48.338245 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User: tempest-VolumesNegativeTest-1174391636-project Oct 26 11:28:48.338245 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Id: default Oct 26 11:28:48.338245 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Name: Default Oct 26 11:28:48.338245 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Id: c2d487cb0b1444f7afb4004486ec7c42 Oct 26 11:28:48.338245 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Name: tempest-VolumesNegativeTest-1174391636-project Oct 26 11:28:48.338245 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: method: Oct 26 11:28:48.338245 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: exception: Volume 52362a29-5310-4dee-a848-e36465eb0c70 could not be found. Oct 26 11:28:48.338245 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: action_args: {'id': '52362a29-5310-4dee-a848-e36465eb0c70'} Oct 26 11:28:48.338245 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:28:48.339411 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:48.339411 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 11:28:48.339411 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 11:28:48.339411 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 26 11:28:48.339411 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 26 11:28:48.339411 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 26 11:28:48.339411 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 26 11:28:48.339411 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 11:28:48.339411 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 11:28:48.339411 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 11:28:48.339411 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 11:28:48.339411 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 11:28:48.339411 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 11:28:48.339411 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 11:28:48.339411 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 11:28:48.339411 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 52362a29-5310-4dee-a848-e36465eb0c70 could not be found. (HTTP 404) (Request-ID: req-bf9f0c4f-a4ef-446e-8e93-81488b91dfd7) Oct 26 11:28:48.339411 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.339411 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:48.339411 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.340856 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:48.340856 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 26 11:28:48.340856 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 26 11:28:48.340856 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 26 11:28:48.340856 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 26 11:28:48.340856 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 26 11:28:48.340856 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 26 11:28:48.340856 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 26 11:28:48.340856 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 26 11:28:48.340856 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 26 11:28:48.340856 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 26 11:28:48.340856 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 26 11:28:48.340856 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 26 11:28:48.340856 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 26 11:28:48.340856 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 26 11:28:48.340856 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 26 11:28:48.340856 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 26 11:28:48.340856 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 26 11:28:48.340856 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 26 11:28:48.342071 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 26 11:28:48.342071 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 26 11:28:48.342071 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 26 11:28:48.342071 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 26 11:28:48.342071 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 52362a29-5310-4dee-a848-e36465eb0c70 could not be found. Oct 26 11:28:48.342071 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.342071 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:48.342071 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.342071 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:48.342071 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:28:48.342071 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:28:48.342071 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:28:48.342071 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:28:48.342071 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 26 11:28:48.342071 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 26 11:28:48.342071 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:28:48.342071 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:28:48.342071 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 26 11:28:48.342071 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:28:48.345027 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 52362a29-5310-4dee-a848-e36465eb0c70 could not be found. Oct 26 11:28:48.345027 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.345027 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:28:48.345027 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.345027 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:28:48.345027 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:28:48.345027 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:28:48.345027 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:28:48.345027 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:28:48.345027 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 52362a29-5310-4dee-a848-e36465eb0c70 could not be found. Oct 26 11:28:48.345027 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:28:48.345027 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-6c8f5fe7-a32e-43f3-8de2-ced8180f61ba tempest-VolumesNegativeTest-1174391636 tempest-VolumesNegativeTest-1174391636-project] Returning 404 to user: Volume 52362a29-5310-4dee-a848-e36465eb0c70 could not be found. {{(pid=119305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:28:48.345027 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-6c8f5fe7-a32e-43f3-8de2-ced8180f61ba tempest-VolumesNegativeTest-1174391636 tempest-VolumesNegativeTest-1174391636-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/52362a29-5310-4dee-a848-e36465eb0c70" status: 404 len: 109 microversion: 2.1 time: 0.036375 Oct 26 11:28:48.345027 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 497/1006] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Oct 26 11:28:48 2022] GET /compute/v2.1/os-volumes/52362a29-5310-4dee-a848-e36465eb0c70 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:28:49.278353 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-efcf2473-ce1a-48f6-b5d2-27e93dfd7e81 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-342134755"}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:28:49.278982 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-efcf2473-ce1a-48f6-b5d2-27e93dfd7e81 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:49.285593 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-efcf2473-ce1a-48f6-b5d2-27e93dfd7e81 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:49.286082 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-efcf2473-ce1a-48f6-b5d2-27e93dfd7e81 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:49.286694 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-efcf2473-ce1a-48f6-b5d2-27e93dfd7e81 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:49.287430 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-efcf2473-ce1a-48f6-b5d2-27e93dfd7e81 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:49.288029 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-efcf2473-ce1a-48f6-b5d2-27e93dfd7e81 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:49.288437 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-efcf2473-ce1a-48f6-b5d2-27e93dfd7e81 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:49.426688 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.network.security_group_api [None req-efcf2473-ce1a-48f6-b5d2-27e93dfd7e81 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Adding security group ba73caf4-4697-4c56-9274-a12d28569beb to port 436d699c-83eb-4925-85b5-851f53994190 Oct 26 11:28:49.822111 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-efcf2473-ce1a-48f6-b5d2-27e93dfd7e81 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "POST /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5/action" status: 202 len: 0 microversion: 2.1 time: 0.548765 Oct 26 11:28:49.826614 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 510/1007] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Oct 26 11:28:49 2022] POST /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 11:28:49.832864 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-9dd570b1-52be-4078-aa86-8f9720f7e328 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:28:49.833516 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-9dd570b1-52be-4078-aa86-8f9720f7e328 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:28:49.841074 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-cd9e2cff-d8ab-459e-aa85-6e35ec1dcb87 req-1bc30f2e-a917-427b-8918-f1cf306da32c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbf3d5fd-8067-49a1-b4e3-51f5949018d5", "tag": "436d699c-83eb-4925-85b5-851f53994190"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:28:49.848734 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9dd570b1-52be-4078-aa86-8f9720f7e328 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:49.850903 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-cd9e2cff-d8ab-459e-aa85-6e35ec1dcb87 req-1bc30f2e-a917-427b-8918-f1cf306da32c service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:49.852346 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-cd9e2cff-d8ab-459e-aa85-6e35ec1dcb87 req-1bc30f2e-a917-427b-8918-f1cf306da32c service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:49.852832 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9dd570b1-52be-4078-aa86-8f9720f7e328 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:49.853206 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9dd570b1-52be-4078-aa86-8f9720f7e328 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:49.853395 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-cd9e2cff-d8ab-459e-aa85-6e35ec1dcb87 req-1bc30f2e-a917-427b-8918-f1cf306da32c service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:49.853974 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9dd570b1-52be-4078-aa86-8f9720f7e328 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:28:49.854460 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9dd570b1-52be-4078-aa86-8f9720f7e328 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:28:49.854918 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9dd570b1-52be-4078-aa86-8f9720f7e328 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:28:49.867516 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-cd9e2cff-d8ab-459e-aa85-6e35ec1dcb87 req-1bc30f2e-a917-427b-8918-f1cf306da32c service nova] Creating event network-changed:436d699c-83eb-4925-85b5-851f53994190 for instance cbf3d5fd-8067-49a1-b4e3-51f5949018d5 on hv-cinder-81558 Oct 26 11:28:49.873597 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-cd9e2cff-d8ab-459e-aa85-6e35ec1dcb87 req-1bc30f2e-a917-427b-8918-f1cf306da32c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035982 Oct 26 11:28:49.874781 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 511/1008] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:28:50.396654 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-9dd570b1-52be-4078-aa86-8f9720f7e328 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:28:50.406638 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-9dd570b1-52be-4078-aa86-8f9720f7e328 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1760 microversion: 2.1 time: 0.578671 Oct 26 11:28:50.407377 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 498/1009] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:28:49 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1760 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:29:05.934525 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=13 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:29:05.935244 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:29:05.940150 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-c9bd4465-54f1-436d-9e6d-9120cc314a68 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:29:05.942380 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-c9bd4465-54f1-436d-9e6d-9120cc314a68 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:29:05.948412 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c9bd4465-54f1-436d-9e6d-9120cc314a68 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:05.948898 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c9bd4465-54f1-436d-9e6d-9120cc314a68 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:05.955172 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c9bd4465-54f1-436d-9e6d-9120cc314a68 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:05.955172 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c9bd4465-54f1-436d-9e6d-9120cc314a68 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:05.955172 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c9bd4465-54f1-436d-9e6d-9120cc314a68 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:05.955172 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c9bd4465-54f1-436d-9e6d-9120cc314a68 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:05.980862 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-c9bd4465-54f1-436d-9e6d-9120cc314a68 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047972 Oct 26 11:29:05.981411 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 512/1010] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Oct 26 11:29:05 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:29:06.047036 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-288e693c-b53d-4959-91ca-26f0e37cb8c5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:29:06.047673 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-288e693c-b53d-4959-91ca-26f0e37cb8c5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:29:06.049838 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_api:SELECT=11 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:29:06.050516 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:29:06.055307 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-288e693c-b53d-4959-91ca-26f0e37cb8c5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:06.055798 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-288e693c-b53d-4959-91ca-26f0e37cb8c5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:06.056238 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-288e693c-b53d-4959-91ca-26f0e37cb8c5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:06.056950 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-288e693c-b53d-4959-91ca-26f0e37cb8c5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:06.057410 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-288e693c-b53d-4959-91ca-26f0e37cb8c5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:06.057838 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-288e693c-b53d-4959-91ca-26f0e37cb8c5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:06.087425 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-288e693c-b53d-4959-91ca-26f0e37cb8c5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Going to try to terminate instance {{(pid=119305) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 11:29:06.393402 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-288e693c-b53d-4959-91ca-26f0e37cb8c5 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "DELETE /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 204 len: 0 microversion: 2.20 time: 0.350825 Oct 26 11:29:06.393983 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 499/1011] 10.222.0.42 () {60 vars in 1280 bytes} [Wed Oct 26 11:29:06 2022] DELETE /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 11:29:06.402394 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-6fc987ea-a5e5-408e-9db5-9cc878c54762 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:29:06.403120 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-6fc987ea-a5e5-408e-9db5-9cc878c54762 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:29:06.410212 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6fc987ea-a5e5-408e-9db5-9cc878c54762 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:06.410694 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6fc987ea-a5e5-408e-9db5-9cc878c54762 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:06.411155 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6fc987ea-a5e5-408e-9db5-9cc878c54762 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:06.411843 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6fc987ea-a5e5-408e-9db5-9cc878c54762 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:06.412303 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6fc987ea-a5e5-408e-9db5-9cc878c54762 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:06.412722 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6fc987ea-a5e5-408e-9db5-9cc878c54762 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:06.540146 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-6fc987ea-a5e5-408e-9db5-9cc878c54762 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:29:06.549187 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-6fc987ea-a5e5-408e-9db5-9cc878c54762 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:29:06.550641 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-6fc987ea-a5e5-408e-9db5-9cc878c54762 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:29:06.551828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-6fc987ea-a5e5-408e-9db5-9cc878c54762 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1724 microversion: 2.20 time: 0.153301 Oct 26 11:29:06.552395 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 513/1012] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:29:06 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:29:07.577421 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-e2715e5d-84a9-4cd2-94e2-a15e86de98b7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:29:07.578121 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-e2715e5d-84a9-4cd2-94e2-a15e86de98b7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:29:07.584718 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e2715e5d-84a9-4cd2-94e2-a15e86de98b7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:07.585240 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e2715e5d-84a9-4cd2-94e2-a15e86de98b7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:07.590966 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e2715e5d-84a9-4cd2-94e2-a15e86de98b7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:07.590966 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e2715e5d-84a9-4cd2-94e2-a15e86de98b7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:07.590966 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e2715e5d-84a9-4cd2-94e2-a15e86de98b7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:07.590966 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e2715e5d-84a9-4cd2-94e2-a15e86de98b7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:07.717603 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-e2715e5d-84a9-4cd2-94e2-a15e86de98b7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:29:07.726564 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-e2715e5d-84a9-4cd2-94e2-a15e86de98b7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:29:07.728073 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-e2715e5d-84a9-4cd2-94e2-a15e86de98b7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:29:07.735848 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-e2715e5d-84a9-4cd2-94e2-a15e86de98b7 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1724 microversion: 2.20 time: 0.156274 Oct 26 11:29:07.735848 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 500/1013] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:29:07 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:29:08.756230 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-2ee578f8-43ca-45e9-afaf-391e5e8b6aec tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:29:08.756856 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-2ee578f8-43ca-45e9-afaf-391e5e8b6aec tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:29:08.763188 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2ee578f8-43ca-45e9-afaf-391e5e8b6aec tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:08.763676 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2ee578f8-43ca-45e9-afaf-391e5e8b6aec tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:08.764112 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2ee578f8-43ca-45e9-afaf-391e5e8b6aec tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:08.764803 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2ee578f8-43ca-45e9-afaf-391e5e8b6aec tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:08.765839 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2ee578f8-43ca-45e9-afaf-391e5e8b6aec tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:08.766265 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2ee578f8-43ca-45e9-afaf-391e5e8b6aec tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:08.908424 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-2ee578f8-43ca-45e9-afaf-391e5e8b6aec tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:29:08.916909 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-2ee578f8-43ca-45e9-afaf-391e5e8b6aec tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:29:08.918414 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-2ee578f8-43ca-45e9-afaf-391e5e8b6aec tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:29:08.919621 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-2ee578f8-43ca-45e9-afaf-391e5e8b6aec tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1724 microversion: 2.20 time: 0.167406 Oct 26 11:29:08.920196 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 514/1014] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:29:08 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:29:09.389135 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-edc9e892-8eb9-4852-947f-cfe8e66cd317 req-787166a2-9e7b-4e3e-b8d1-93cdfee2a009 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "032aed92-2b14-4791-8612-a0261e6d77fd", "name": "network-vif-deleted", "tag": "d48eea34-8900-4e01-bcd5-3b4a5f2f3dd1"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:29:09.399850 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-edc9e892-8eb9-4852-947f-cfe8e66cd317 req-787166a2-9e7b-4e3e-b8d1-93cdfee2a009 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:09.400596 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-edc9e892-8eb9-4852-947f-cfe8e66cd317 req-787166a2-9e7b-4e3e-b8d1-93cdfee2a009 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:09.401123 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-edc9e892-8eb9-4852-947f-cfe8e66cd317 req-787166a2-9e7b-4e3e-b8d1-93cdfee2a009 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:09.413777 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-edc9e892-8eb9-4852-947f-cfe8e66cd317 req-787166a2-9e7b-4e3e-b8d1-93cdfee2a009 service nova] Creating event network-vif-deleted:d48eea34-8900-4e01-bcd5-3b4a5f2f3dd1 for instance 032aed92-2b14-4791-8612-a0261e6d77fd on hv-cinder-81558 Oct 26 11:29:09.418981 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-edc9e892-8eb9-4852-947f-cfe8e66cd317 req-787166a2-9e7b-4e3e-b8d1-93cdfee2a009 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171686 Oct 26 11:29:09.419703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 501/1015] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:29:09.945501 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e4bb587d-52b1-4df7-9d06-0060ef8f7aad tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:29:09.946107 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-e4bb587d-52b1-4df7-9d06-0060ef8f7aad tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:29:09.952521 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e4bb587d-52b1-4df7-9d06-0060ef8f7aad tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:09.953480 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e4bb587d-52b1-4df7-9d06-0060ef8f7aad tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:09.953909 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e4bb587d-52b1-4df7-9d06-0060ef8f7aad tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:09.954614 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e4bb587d-52b1-4df7-9d06-0060ef8f7aad tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:09.955072 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e4bb587d-52b1-4df7-9d06-0060ef8f7aad tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:09.955502 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e4bb587d-52b1-4df7-9d06-0060ef8f7aad tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:09.986935 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e4bb587d-52b1-4df7-9d06-0060ef8f7aad tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:09.987421 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e4bb587d-52b1-4df7-9d06-0060ef8f7aad tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:09.987854 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e4bb587d-52b1-4df7-9d06-0060ef8f7aad tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:09.988311 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.objects.instance [None req-e4bb587d-52b1-4df7-9d06-0060ef8f7aad tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lazy-loading 'fault' on Instance uuid 032aed92-2b14-4791-8612-a0261e6d77fd {{(pid=119306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:29:10.029687 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-e4bb587d-52b1-4df7-9d06-0060ef8f7aad tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:29:10.038053 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-e4bb587d-52b1-4df7-9d06-0060ef8f7aad tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:29:10.039574 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-e4bb587d-52b1-4df7-9d06-0060ef8f7aad tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41276c93e476436791b89ab8a0d4537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29bf15969d46da9670efa2b52e6676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:29:10.040736 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-e4bb587d-52b1-4df7-9d06-0060ef8f7aad tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 200 len: 1372 microversion: 2.20 time: 0.099108 Oct 26 11:29:10.041304 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 515/1016] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:29:09 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 26 11:29:11.066679 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a9f5b8ea-126f-4869-8f07-ea83c089ffe9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:29:11.067452 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-a9f5b8ea-126f-4869-8f07-ea83c089ffe9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:29:11.073562 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a9f5b8ea-126f-4869-8f07-ea83c089ffe9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:11.074053 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a9f5b8ea-126f-4869-8f07-ea83c089ffe9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:11.074530 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a9f5b8ea-126f-4869-8f07-ea83c089ffe9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:11.075249 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a9f5b8ea-126f-4869-8f07-ea83c089ffe9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:11.075711 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a9f5b8ea-126f-4869-8f07-ea83c089ffe9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:11.076143 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a9f5b8ea-126f-4869-8f07-ea83c089ffe9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:11.089814 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.wsgi [None req-a9f5b8ea-126f-4869-8f07-ea83c089ffe9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] HTTP exception thrown: Instance 032aed92-2b14-4791-8612-a0261e6d77fd could not be found. Oct 26 11:29:11.091467 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a9f5b8ea-126f-4869-8f07-ea83c089ffe9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Request method failure captured: Oct 26 11:29:11.091467 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: request: GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd HTTP/1.1 Oct 26 11:29:11.091467 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept: application/json Oct 26 11:29:11.091467 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept-Encoding: identity Oct 26 11:29:11.091467 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Connection: close Oct 26 11:29:11.091467 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Length: 0 Oct 26 11:29:11.091467 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Type: application/json Oct 26 11:29:11.091467 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Host: 10.222.0.42 Oct 26 11:29:11.091467 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Openstack-System-Scope: None Oct 26 11:29:11.091467 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: User-Agent: python-urllib3/1.26.12 Oct 26 11:29:11.091467 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Auth-Token: gAAAAABjWRdv0aSpSzvPcVWphOtqPXyKdasF2RVRrPNaRgWwBP0LqdMWrJ85_uRmo9VD_X4IUYNpvQRCl3ABu8z9MPkgOos9-Ibll7dsuwae0BX7ur_YlLAoksXsMIHdBaQkRkeWoyQelNp3i6Eh-ZJgcRTHM-z5nAi4rzAFiebDUqVJTNEViN8 Oct 26 11:29:11.091467 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Id: None Oct 26 11:29:11.091467 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Name: None Oct 26 11:29:11.091467 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Identity-Status: Confirmed Oct 26 11:29:11.091467 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Is-Admin-Project: True Oct 26 11:29:11.091467 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Openstack-Nova-Api-Version: 2.20 Oct 26 11:29:11.091467 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Id: default Oct 26 11:29:11.091467 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Name: Default Oct 26 11:29:11.091467 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Id: ab29bf15969d46da9670efa2b52e6676 Oct 26 11:29:11.091467 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-531427414 Oct 26 11:29:11.091467 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Role: member,reader Oct 26 11:29:11.091467 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Roles: member,reader Oct 26 11:29:11.093845 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ab29bf15969d46da9670efa2b52e6676", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab29bf15969d46da9670efa2b52e6676"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ab29bf15969d46da9670efa2b52e6676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab29bf15969d46da9670efa2b52e6676"}]}] Oct 26 11:29:11.093845 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant: tempest-AttachVolumeShelveTestJSON-531427414 Oct 26 11:29:11.093845 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Id: ab29bf15969d46da9670efa2b52e6676 Oct 26 11:29:11.093845 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-531427414 Oct 26 11:29:11.093845 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User: tempest-AttachVolumeShelveTestJSON-531427414-project Oct 26 11:29:11.093845 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Id: default Oct 26 11:29:11.093845 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Name: Default Oct 26 11:29:11.093845 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Id: 41276c93e476436791b89ab8a0d4537d Oct 26 11:29:11.093845 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Name: tempest-AttachVolumeShelveTestJSON-531427414-project Oct 26 11:29:11.093845 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: method: > Oct 26 11:29:11.093845 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: exception: Instance 032aed92-2b14-4791-8612-a0261e6d77fd could not be found. Oct 26 11:29:11.093845 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: action_args: {'id': '032aed92-2b14-4791-8612-a0261e6d77fd'} Oct 26 11:29:11.095117 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:29:11.095117 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:29:11.095117 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:29:11.095117 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:29:11.095117 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:29:11.095117 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:29:11.095117 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:29:11.095117 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:29:11.095117 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:29:11.095117 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:29:11.095117 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 032aed92-2b14-4791-8612-a0261e6d77fd could not be found. Oct 26 11:29:11.095117 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:29:11.095117 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:29:11.095117 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:29:11.095117 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:29:11.095117 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:29:11.095117 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:29:11.095117 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:29:11.095117 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:29:11.095117 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:29:11.096577 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:29:11.096577 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 11:29:11.096577 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 11:29:11.096577 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:29:11.096577 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:29:11.096577 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:29:11.096577 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:29:11.096577 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 032aed92-2b14-4791-8612-a0261e6d77fd could not be found. Oct 26 11:29:11.096577 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:29:11.096577 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:29:11.096577 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:29:11.096577 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:29:11.096577 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:29:11.096577 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:29:11.096577 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:29:11.096577 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:29:11.096577 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 032aed92-2b14-4791-8612-a0261e6d77fd could not be found. Oct 26 11:29:11.096577 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:29:11.098327 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a9f5b8ea-126f-4869-8f07-ea83c089ffe9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Returning 404 to user: Instance 032aed92-2b14-4791-8612-a0261e6d77fd could not be found. {{(pid=119305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:29:11.098327 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-a9f5b8ea-126f-4869-8f07-ea83c089ffe9 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 404 len: 111 microversion: 2.20 time: 0.030964 Oct 26 11:29:11.098327 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 502/1017] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:29:11 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 11:29:11.102268 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-558239aa-d155-44ea-9a74-8a0c628c7a91 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '.version_select at 0x7f6b93827f70>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:29:11.106865 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR oslo.messaging._drivers.impl_rabbit [None req-558239aa-d155-44ea-9a74-8a0c628c7a91 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [53f07c66-ec8f-4976-9235-757ef890b38d] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 11:29:12.114699 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO oslo.messaging._drivers.impl_rabbit [None req-558239aa-d155-44ea-9a74-8a0c628c7a91 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [53f07c66-ec8f-4976-9235-757ef890b38d] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 36334. Oct 26 11:29:12.195005 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-558239aa-d155-44ea-9a74-8a0c628c7a91 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1790893251" status: 204 len: 0 microversion: 2.20 time: 1.096471 Oct 26 11:29:12.195603 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 516/1018] 10.222.0.42 () {60 vars in 1262 bytes} [Wed Oct 26 11:29:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1790893251 => generated 0 bytes in 1098 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 26 11:29:14.641762 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-5854228d-380a-417a-926e-b2f1f0439265 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:29:14.642261 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-5854228d-380a-417a-926e-b2f1f0439265 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:29:14.648799 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5854228d-380a-417a-926e-b2f1f0439265 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:14.649275 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5854228d-380a-417a-926e-b2f1f0439265 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:14.649704 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5854228d-380a-417a-926e-b2f1f0439265 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:14.650387 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5854228d-380a-417a-926e-b2f1f0439265 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:14.650887 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5854228d-380a-417a-926e-b2f1f0439265 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:14.651307 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5854228d-380a-417a-926e-b2f1f0439265 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:14.664937 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.wsgi [None req-5854228d-380a-417a-926e-b2f1f0439265 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] HTTP exception thrown: Instance 032aed92-2b14-4791-8612-a0261e6d77fd could not be found. Oct 26 11:29:14.666472 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-5854228d-380a-417a-926e-b2f1f0439265 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Request method failure captured: Oct 26 11:29:14.666472 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: request: DELETE /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd HTTP/1.1 Oct 26 11:29:14.666472 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept: application/json Oct 26 11:29:14.666472 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept-Encoding: identity Oct 26 11:29:14.666472 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Connection: close Oct 26 11:29:14.666472 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Length: 0 Oct 26 11:29:14.666472 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Type: application/json Oct 26 11:29:14.666472 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Host: 10.222.0.42 Oct 26 11:29:14.666472 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Openstack-System-Scope: None Oct 26 11:29:14.666472 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: User-Agent: python-urllib3/1.26.12 Oct 26 11:29:14.666472 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Auth-Token: gAAAAABjWRdv0aSpSzvPcVWphOtqPXyKdasF2RVRrPNaRgWwBP0LqdMWrJ85_uRmo9VD_X4IUYNpvQRCl3ABu8z9MPkgOos9-Ibll7dsuwae0BX7ur_YlLAoksXsMIHdBaQkRkeWoyQelNp3i6Eh-ZJgcRTHM-z5nAi4rzAFiebDUqVJTNEViN8 Oct 26 11:29:14.666472 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Id: None Oct 26 11:29:14.666472 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Name: None Oct 26 11:29:14.666472 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Identity-Status: Confirmed Oct 26 11:29:14.666472 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Is-Admin-Project: True Oct 26 11:29:14.666472 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Openstack-Nova-Api-Version: 2.20 Oct 26 11:29:14.666472 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Id: default Oct 26 11:29:14.666472 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Name: Default Oct 26 11:29:14.666472 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Id: ab29bf15969d46da9670efa2b52e6676 Oct 26 11:29:14.666472 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-531427414 Oct 26 11:29:14.666472 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Role: member,reader Oct 26 11:29:14.666472 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Roles: member,reader Oct 26 11:29:14.668322 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ab29bf15969d46da9670efa2b52e6676", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab29bf15969d46da9670efa2b52e6676"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ab29bf15969d46da9670efa2b52e6676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab29bf15969d46da9670efa2b52e6676"}]}] Oct 26 11:29:14.668322 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant: tempest-AttachVolumeShelveTestJSON-531427414 Oct 26 11:29:14.668322 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Id: ab29bf15969d46da9670efa2b52e6676 Oct 26 11:29:14.668322 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-531427414 Oct 26 11:29:14.668322 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User: tempest-AttachVolumeShelveTestJSON-531427414-project Oct 26 11:29:14.668322 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Id: default Oct 26 11:29:14.668322 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Name: Default Oct 26 11:29:14.668322 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Id: 41276c93e476436791b89ab8a0d4537d Oct 26 11:29:14.668322 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Name: tempest-AttachVolumeShelveTestJSON-531427414-project Oct 26 11:29:14.668322 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: method: > Oct 26 11:29:14.668322 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: exception: Instance 032aed92-2b14-4791-8612-a0261e6d77fd could not be found. Oct 26 11:29:14.668322 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: action_args: {'id': '032aed92-2b14-4791-8612-a0261e6d77fd'} Oct 26 11:29:14.669722 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:29:14.669722 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:29:14.669722 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:29:14.669722 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:29:14.669722 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:29:14.669722 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:29:14.669722 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:29:14.669722 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:29:14.669722 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:29:14.669722 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:29:14.669722 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 032aed92-2b14-4791-8612-a0261e6d77fd could not be found. Oct 26 11:29:14.669722 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:29:14.669722 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:29:14.669722 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:29:14.669722 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:29:14.669722 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:29:14.669722 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:29:14.669722 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:29:14.669722 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:29:14.669722 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:29:14.671338 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:29:14.671338 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 11:29:14.671338 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 11:29:14.671338 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 11:29:14.671338 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 11:29:14.671338 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:29:14.671338 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:29:14.671338 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:29:14.671338 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:29:14.671338 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 032aed92-2b14-4791-8612-a0261e6d77fd could not be found. Oct 26 11:29:14.671338 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:29:14.671338 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:29:14.671338 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:29:14.671338 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:29:14.671338 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:29:14.671338 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:29:14.671338 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:29:14.671338 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:29:14.671338 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 032aed92-2b14-4791-8612-a0261e6d77fd could not be found. Oct 26 11:29:14.671338 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:29:14.673630 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-5854228d-380a-417a-926e-b2f1f0439265 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Returning 404 to user: Instance 032aed92-2b14-4791-8612-a0261e6d77fd could not be found. {{(pid=119305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:29:14.673630 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-5854228d-380a-417a-926e-b2f1f0439265 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "DELETE /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 404 len: 111 microversion: 2.20 time: 0.030011 Oct 26 11:29:14.673630 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 503/1019] 10.222.0.42 () {60 vars in 1280 bytes} [Wed Oct 26 11:29:14 2022] DELETE /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 11:29:14.676975 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-48f60cc8-8683-422f-8788-75f82bb6fc6e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:29:14.677573 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-48f60cc8-8683-422f-8788-75f82bb6fc6e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 032aed92-2b14-4791-8612-a0261e6d77fd] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:29:14.684787 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-48f60cc8-8683-422f-8788-75f82bb6fc6e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:14.685267 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-48f60cc8-8683-422f-8788-75f82bb6fc6e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:14.685699 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-48f60cc8-8683-422f-8788-75f82bb6fc6e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:14.686381 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-48f60cc8-8683-422f-8788-75f82bb6fc6e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:14.686849 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-48f60cc8-8683-422f-8788-75f82bb6fc6e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:14.687282 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-48f60cc8-8683-422f-8788-75f82bb6fc6e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:14.701177 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.wsgi [None req-48f60cc8-8683-422f-8788-75f82bb6fc6e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] HTTP exception thrown: Instance 032aed92-2b14-4791-8612-a0261e6d77fd could not be found. Oct 26 11:29:14.702872 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-48f60cc8-8683-422f-8788-75f82bb6fc6e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Request method failure captured: Oct 26 11:29:14.702872 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: request: GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd HTTP/1.1 Oct 26 11:29:14.702872 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept: application/json Oct 26 11:29:14.702872 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept-Encoding: identity Oct 26 11:29:14.702872 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Connection: close Oct 26 11:29:14.702872 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Length: 0 Oct 26 11:29:14.702872 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Type: application/json Oct 26 11:29:14.702872 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Host: 10.222.0.42 Oct 26 11:29:14.702872 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Openstack-System-Scope: None Oct 26 11:29:14.702872 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: User-Agent: python-urllib3/1.26.12 Oct 26 11:29:14.702872 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Auth-Token: gAAAAABjWRdv0aSpSzvPcVWphOtqPXyKdasF2RVRrPNaRgWwBP0LqdMWrJ85_uRmo9VD_X4IUYNpvQRCl3ABu8z9MPkgOos9-Ibll7dsuwae0BX7ur_YlLAoksXsMIHdBaQkRkeWoyQelNp3i6Eh-ZJgcRTHM-z5nAi4rzAFiebDUqVJTNEViN8 Oct 26 11:29:14.702872 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Id: None Oct 26 11:29:14.702872 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Name: None Oct 26 11:29:14.702872 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Identity-Status: Confirmed Oct 26 11:29:14.702872 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Is-Admin-Project: True Oct 26 11:29:14.702872 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Openstack-Nova-Api-Version: 2.20 Oct 26 11:29:14.702872 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Id: default Oct 26 11:29:14.702872 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Name: Default Oct 26 11:29:14.702872 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Id: ab29bf15969d46da9670efa2b52e6676 Oct 26 11:29:14.702872 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-531427414 Oct 26 11:29:14.702872 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Role: member,reader Oct 26 11:29:14.702872 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Roles: member,reader Oct 26 11:29:14.704667 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ab29bf15969d46da9670efa2b52e6676", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab29bf15969d46da9670efa2b52e6676"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ab29bf15969d46da9670efa2b52e6676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab29bf15969d46da9670efa2b52e6676"}]}] Oct 26 11:29:14.704667 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant: tempest-AttachVolumeShelveTestJSON-531427414 Oct 26 11:29:14.704667 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Id: ab29bf15969d46da9670efa2b52e6676 Oct 26 11:29:14.704667 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-531427414 Oct 26 11:29:14.704667 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User: tempest-AttachVolumeShelveTestJSON-531427414-project Oct 26 11:29:14.704667 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Id: default Oct 26 11:29:14.704667 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Name: Default Oct 26 11:29:14.704667 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Id: 41276c93e476436791b89ab8a0d4537d Oct 26 11:29:14.704667 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Name: tempest-AttachVolumeShelveTestJSON-531427414-project Oct 26 11:29:14.704667 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: method: > Oct 26 11:29:14.704667 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: exception: Instance 032aed92-2b14-4791-8612-a0261e6d77fd could not be found. Oct 26 11:29:14.704667 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: action_args: {'id': '032aed92-2b14-4791-8612-a0261e6d77fd'} Oct 26 11:29:14.705721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:29:14.705721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:29:14.705721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:29:14.705721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:29:14.705721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:29:14.705721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:29:14.705721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:29:14.705721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:29:14.705721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:29:14.705721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:29:14.705721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 032aed92-2b14-4791-8612-a0261e6d77fd could not be found. Oct 26 11:29:14.705721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:29:14.705721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:29:14.705721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:29:14.705721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:29:14.705721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:29:14.705721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:29:14.705721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:29:14.705721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:29:14.705721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:29:14.707242 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:29:14.707242 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 11:29:14.707242 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 11:29:14.707242 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:29:14.707242 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:29:14.707242 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:29:14.707242 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:29:14.707242 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 032aed92-2b14-4791-8612-a0261e6d77fd could not be found. Oct 26 11:29:14.707242 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:29:14.707242 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:29:14.707242 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:29:14.707242 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:29:14.707242 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:29:14.707242 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:29:14.707242 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:29:14.707242 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:29:14.707242 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 032aed92-2b14-4791-8612-a0261e6d77fd could not be found. Oct 26 11:29:14.707242 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:29:14.708818 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-48f60cc8-8683-422f-8788-75f82bb6fc6e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Returning 404 to user: Instance 032aed92-2b14-4791-8612-a0261e6d77fd could not be found. {{(pid=119306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:29:14.708818 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-48f60cc8-8683-422f-8788-75f82bb6fc6e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd" status: 404 len: 111 microversion: 2.20 time: 0.031852 Oct 26 11:29:14.708818 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 517/1020] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:29:14 2022] GET /compute/v2.1/servers/032aed92-2b14-4791-8612-a0261e6d77fd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 11:29:15.993526 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-f03c85b0-f791-4313-9749-f44d805a3846 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:29:15.994027 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-f03c85b0-f791-4313-9749-f44d805a3846 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:29:16.000990 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f03c85b0-f791-4313-9749-f44d805a3846 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:16.001918 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f03c85b0-f791-4313-9749-f44d805a3846 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:16.001918 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f03c85b0-f791-4313-9749-f44d805a3846 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:16.002612 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f03c85b0-f791-4313-9749-f44d805a3846 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:16.003097 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f03c85b0-f791-4313-9749-f44d805a3846 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:16.003525 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-f03c85b0-f791-4313-9749-f44d805a3846 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:16.017469 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.wsgi [None req-f03c85b0-f791-4313-9749-f44d805a3846 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] HTTP exception thrown: Instance 2821a8ff-1cb6-43c5-9968-1c13e293ad1a could not be found. Oct 26 11:29:16.019051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-f03c85b0-f791-4313-9749-f44d805a3846 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Request method failure captured: Oct 26 11:29:16.019051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: request: DELETE /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a HTTP/1.1 Oct 26 11:29:16.019051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept: application/json Oct 26 11:29:16.019051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept-Encoding: identity Oct 26 11:29:16.019051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Connection: close Oct 26 11:29:16.019051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Length: 0 Oct 26 11:29:16.019051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Type: application/json Oct 26 11:29:16.019051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Host: 10.222.0.42 Oct 26 11:29:16.019051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Openstack-System-Scope: None Oct 26 11:29:16.019051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: User-Agent: python-urllib3/1.26.12 Oct 26 11:29:16.019051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Auth-Token: gAAAAABjWRdv0aSpSzvPcVWphOtqPXyKdasF2RVRrPNaRgWwBP0LqdMWrJ85_uRmo9VD_X4IUYNpvQRCl3ABu8z9MPkgOos9-Ibll7dsuwae0BX7ur_YlLAoksXsMIHdBaQkRkeWoyQelNp3i6Eh-ZJgcRTHM-z5nAi4rzAFiebDUqVJTNEViN8 Oct 26 11:29:16.019051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Id: None Oct 26 11:29:16.019051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Name: None Oct 26 11:29:16.019051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Identity-Status: Confirmed Oct 26 11:29:16.019051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Is-Admin-Project: True Oct 26 11:29:16.019051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Openstack-Nova-Api-Version: 2.20 Oct 26 11:29:16.019051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Id: default Oct 26 11:29:16.019051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Name: Default Oct 26 11:29:16.019051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Id: ab29bf15969d46da9670efa2b52e6676 Oct 26 11:29:16.019051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-531427414 Oct 26 11:29:16.019051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Role: member,reader Oct 26 11:29:16.019051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Roles: member,reader Oct 26 11:29:16.020644 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ab29bf15969d46da9670efa2b52e6676", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab29bf15969d46da9670efa2b52e6676"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ab29bf15969d46da9670efa2b52e6676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab29bf15969d46da9670efa2b52e6676"}]}] Oct 26 11:29:16.020644 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant: tempest-AttachVolumeShelveTestJSON-531427414 Oct 26 11:29:16.020644 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Id: ab29bf15969d46da9670efa2b52e6676 Oct 26 11:29:16.020644 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-531427414 Oct 26 11:29:16.020644 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User: tempest-AttachVolumeShelveTestJSON-531427414-project Oct 26 11:29:16.020644 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Id: default Oct 26 11:29:16.020644 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Name: Default Oct 26 11:29:16.020644 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Id: 41276c93e476436791b89ab8a0d4537d Oct 26 11:29:16.020644 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Name: tempest-AttachVolumeShelveTestJSON-531427414-project Oct 26 11:29:16.020644 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: method: > Oct 26 11:29:16.020644 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: exception: Instance 2821a8ff-1cb6-43c5-9968-1c13e293ad1a could not be found. Oct 26 11:29:16.020644 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: action_args: {'id': '2821a8ff-1cb6-43c5-9968-1c13e293ad1a'} Oct 26 11:29:16.021390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:29:16.021390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:29:16.021390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:29:16.021390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:29:16.021390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:29:16.021390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:29:16.021390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:29:16.021390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:29:16.021390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:29:16.021390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:29:16.021390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2821a8ff-1cb6-43c5-9968-1c13e293ad1a could not be found. Oct 26 11:29:16.021390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:29:16.021390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:29:16.021390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:29:16.021390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:29:16.021390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:29:16.021390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:29:16.021390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:29:16.021390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:29:16.021390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:29:16.022648 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:29:16.022648 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 11:29:16.022648 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 11:29:16.022648 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 11:29:16.022648 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 11:29:16.022648 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:29:16.022648 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:29:16.022648 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:29:16.022648 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:29:16.022648 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2821a8ff-1cb6-43c5-9968-1c13e293ad1a could not be found. Oct 26 11:29:16.022648 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:29:16.022648 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:29:16.022648 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:29:16.022648 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:29:16.022648 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:29:16.022648 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:29:16.022648 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:29:16.022648 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:29:16.022648 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2821a8ff-1cb6-43c5-9968-1c13e293ad1a could not be found. Oct 26 11:29:16.022648 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:29:16.025916 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-f03c85b0-f791-4313-9749-f44d805a3846 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Returning 404 to user: Instance 2821a8ff-1cb6-43c5-9968-1c13e293ad1a could not be found. {{(pid=119305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:29:16.025916 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-f03c85b0-f791-4313-9749-f44d805a3846 tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 404 len: 111 microversion: 2.20 time: 0.030824 Oct 26 11:29:16.025916 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 504/1021] 10.222.0.42 () {60 vars in 1280 bytes} [Wed Oct 26 11:29:15 2022] DELETE /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 26 11:29:16.030374 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-5bf62722-ba94-45d6-ae1b-228c1acdb09e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:29:16.031024 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-5bf62722-ba94-45d6-ae1b-228c1acdb09e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] [instance: 2821a8ff-1cb6-43c5-9968-1c13e293ad1a] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:29:16.038147 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5bf62722-ba94-45d6-ae1b-228c1acdb09e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:16.038778 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5bf62722-ba94-45d6-ae1b-228c1acdb09e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:16.039429 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5bf62722-ba94-45d6-ae1b-228c1acdb09e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:16.040183 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5bf62722-ba94-45d6-ae1b-228c1acdb09e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:16.040632 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5bf62722-ba94-45d6-ae1b-228c1acdb09e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:16.041183 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5bf62722-ba94-45d6-ae1b-228c1acdb09e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:16.054810 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.wsgi [None req-5bf62722-ba94-45d6-ae1b-228c1acdb09e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] HTTP exception thrown: Instance 2821a8ff-1cb6-43c5-9968-1c13e293ad1a could not be found. Oct 26 11:29:16.062259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-5bf62722-ba94-45d6-ae1b-228c1acdb09e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Request method failure captured: Oct 26 11:29:16.062259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: request: GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a HTTP/1.1 Oct 26 11:29:16.062259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept: application/json Oct 26 11:29:16.062259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept-Encoding: identity Oct 26 11:29:16.062259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Connection: close Oct 26 11:29:16.062259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Length: 0 Oct 26 11:29:16.062259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Type: application/json Oct 26 11:29:16.062259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Host: 10.222.0.42 Oct 26 11:29:16.062259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Openstack-System-Scope: None Oct 26 11:29:16.062259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: User-Agent: python-urllib3/1.26.12 Oct 26 11:29:16.062259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Auth-Token: gAAAAABjWRdv0aSpSzvPcVWphOtqPXyKdasF2RVRrPNaRgWwBP0LqdMWrJ85_uRmo9VD_X4IUYNpvQRCl3ABu8z9MPkgOos9-Ibll7dsuwae0BX7ur_YlLAoksXsMIHdBaQkRkeWoyQelNp3i6Eh-ZJgcRTHM-z5nAi4rzAFiebDUqVJTNEViN8 Oct 26 11:29:16.062259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Id: None Oct 26 11:29:16.062259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Name: None Oct 26 11:29:16.062259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Identity-Status: Confirmed Oct 26 11:29:16.062259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Is-Admin-Project: True Oct 26 11:29:16.062259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Openstack-Nova-Api-Version: 2.20 Oct 26 11:29:16.062259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Id: default Oct 26 11:29:16.062259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Name: Default Oct 26 11:29:16.062259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Id: ab29bf15969d46da9670efa2b52e6676 Oct 26 11:29:16.062259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-531427414 Oct 26 11:29:16.062259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Role: member,reader Oct 26 11:29:16.062259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Roles: member,reader Oct 26 11:29:16.064245 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ab29bf15969d46da9670efa2b52e6676", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab29bf15969d46da9670efa2b52e6676"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ab29bf15969d46da9670efa2b52e6676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab29bf15969d46da9670efa2b52e6676"}]}] Oct 26 11:29:16.064245 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant: tempest-AttachVolumeShelveTestJSON-531427414 Oct 26 11:29:16.064245 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Id: ab29bf15969d46da9670efa2b52e6676 Oct 26 11:29:16.064245 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-531427414 Oct 26 11:29:16.064245 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User: tempest-AttachVolumeShelveTestJSON-531427414-project Oct 26 11:29:16.064245 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Id: default Oct 26 11:29:16.064245 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Name: Default Oct 26 11:29:16.064245 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Id: 41276c93e476436791b89ab8a0d4537d Oct 26 11:29:16.064245 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Name: tempest-AttachVolumeShelveTestJSON-531427414-project Oct 26 11:29:16.064245 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: method: > Oct 26 11:29:16.064245 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: exception: Instance 2821a8ff-1cb6-43c5-9968-1c13e293ad1a could not be found. Oct 26 11:29:16.064245 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: action_args: {'id': '2821a8ff-1cb6-43c5-9968-1c13e293ad1a'} Oct 26 11:29:16.065534 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:29:16.065534 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:29:16.065534 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:29:16.065534 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:29:16.065534 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:29:16.065534 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:29:16.065534 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:29:16.065534 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:29:16.065534 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:29:16.065534 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:29:16.065534 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2821a8ff-1cb6-43c5-9968-1c13e293ad1a could not be found. Oct 26 11:29:16.065534 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:29:16.065534 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:29:16.065534 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:29:16.065534 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:29:16.065534 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:29:16.065534 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:29:16.065534 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:29:16.065534 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:29:16.065534 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:29:16.066837 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:29:16.066837 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 11:29:16.066837 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 11:29:16.066837 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:29:16.066837 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:29:16.066837 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:29:16.066837 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:29:16.066837 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2821a8ff-1cb6-43c5-9968-1c13e293ad1a could not be found. Oct 26 11:29:16.066837 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:29:16.066837 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:29:16.066837 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:29:16.066837 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:29:16.066837 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:29:16.066837 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:29:16.066837 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:29:16.066837 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:29:16.066837 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2821a8ff-1cb6-43c5-9968-1c13e293ad1a could not be found. Oct 26 11:29:16.066837 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:29:16.068210 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-5bf62722-ba94-45d6-ae1b-228c1acdb09e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] Returning 404 to user: Instance 2821a8ff-1cb6-43c5-9968-1c13e293ad1a could not be found. {{(pid=119306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:29:16.068210 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-5bf62722-ba94-45d6-ae1b-228c1acdb09e tempest-AttachVolumeShelveTestJSON-531427414 tempest-AttachVolumeShelveTestJSON-531427414-project] 10.222.0.42 "GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a" status: 404 len: 111 microversion: 2.20 time: 0.032320 Oct 26 11:29:16.068210 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 518/1022] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Oct 26 11:29:16 2022] GET /compute/v2.1/servers/2821a8ff-1cb6-43c5-9968-1c13e293ad1a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 26 11:29:26.790613 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:29:26.791827 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:29:26.908745 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-ea7de53a-fdcc-4b40-a1d6-5216112a4f4a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Action: 'create', calling method: .version_select at 0x7f6b970050d0>, body: {"keypair": {"name": "tempest-keypair-415842504", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6+oNN15739/Ky06vTjuMPnrtx8PoJVY28N6USEwdR9hWuwZkLPBrKJD3fiWlKfeFGeMz/42+L2Bq6u7DJyvRKHX4R+KjShhHbV9jET1k5m/nii8u1C309jf78NvkqgTA=="}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:29:26.925799 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.quota [None req-ea7de53a-fdcc-4b40-a1d6-5216112a4f4a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Getting quotas for project b78491741fc7450b932b7a43e5d3bb92. Resources: {'key_pairs'} {{(pid=119305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:29:26.929899 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.quota [None req-ea7de53a-fdcc-4b40-a1d6-5216112a4f4a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Getting quotas for user 80087d6fbe284b02b20c64ce3237d3b5 and project b78491741fc7450b932b7a43e5d3bb92. Resources: {'key_pairs'} {{(pid=119305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:29:27.013043 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-ea7de53a-fdcc-4b40-a1d6-5216112a4f4a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.227952 Oct 26 11:29:27.013896 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 505/1023] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Oct 26 11:29:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:29:29.582166 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-c6ad1bef-9331-44b7-ad0c-23a9b391ceab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1996388399", "imageRef": "ed8b5733-339c-4fa7-9767-abef514cb9f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "75737873-3b56-4732-b134-9315e0673dae"}], "security_groups": [{"name": "tempest-securitygroup--1430379954"}], "key_name": "tempest-keypair-415842504", "user_data": "}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:29:29.592506 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:29:29.593116 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=30 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:29:29.688565 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.network.neutron [None req-c6ad1bef-9331-44b7-ad0c-23a9b391ceab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] validate_networks() for [('75737873-3b56-4732-b134-9315e0673dae', None, None, None, None, None)] {{(pid=119306) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 11:29:30.199927 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-c6ad1bef-9331-44b7-ad0c-23a9b391ceab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Flavor limits 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 11:29:30.199927 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-c6ad1bef-9331-44b7-ad0c-23a9b391ceab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Image limits 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 11:29:30.199927 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-c6ad1bef-9331-44b7-ad0c-23a9b391ceab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Flavor pref 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 11:29:30.200454 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-c6ad1bef-9331-44b7-ad0c-23a9b391ceab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Image pref 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 11:29:30.200874 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-c6ad1bef-9331-44b7-ad0c-23a9b391ceab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 11:29:30.210320 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c6ad1bef-9331-44b7-ad0c-23a9b391ceab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:30.210899 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c6ad1bef-9331-44b7-ad0c-23a9b391ceab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:30.211333 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c6ad1bef-9331-44b7-ad0c-23a9b391ceab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:30.212059 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c6ad1bef-9331-44b7-ad0c-23a9b391ceab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:30.212506 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c6ad1bef-9331-44b7-ad0c-23a9b391ceab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:30.212923 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c6ad1bef-9331-44b7-ad0c-23a9b391ceab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:30.230563 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-c6ad1bef-9331-44b7-ad0c-23a9b391ceab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Getting quotas for project b78491741fc7450b932b7a43e5d3bb92. Resources: {'cores', 'instances', 'ram'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:29:30.235454 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-c6ad1bef-9331-44b7-ad0c-23a9b391ceab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Getting quotas for user 80087d6fbe284b02b20c64ce3237d3b5 and project b78491741fc7450b932b7a43e5d3bb92. Resources: {'cores', 'instances', 'ram'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:29:30.246522 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-c6ad1bef-9331-44b7-ad0c-23a9b391ceab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Going to run 1 instances... {{(pid=119306) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 11:29:30.250248 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-c6ad1bef-9331-44b7-ad0c-23a9b391ceab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed8b5733-339c-4fa7-9767-abef514cb9f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119306) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 11:29:30.416509 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-c6ad1bef-9331-44b7-ad0c-23a9b391ceab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.839161 Oct 26 11:29:30.417367 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 519/1024] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Oct 26 11:29:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 11:29:30.429408 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-f64e51e7-c126-4132-ac58-0dc4f0fa7c76 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:29:30.430044 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-f64e51e7-c126-4132-ac58-0dc4f0fa7c76 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:29:30.494076 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-f64e51e7-c126-4132-ac58-0dc4f0fa7c76 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:29:30.502037 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-f64e51e7-c126-4132-ac58-0dc4f0fa7c76 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1237 microversion: 2.1 time: 0.076630 Oct 26 11:29:30.510811 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 506/1025] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:29:30 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1237 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:29:31.525887 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-8275a7ae-bd39-469c-bffc-0db692f3a719 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:29:31.526511 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-8275a7ae-bd39-469c-bffc-0db692f3a719 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:29:31.533293 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8275a7ae-bd39-469c-bffc-0db692f3a719 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:31.537471 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8275a7ae-bd39-469c-bffc-0db692f3a719 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:31.537471 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8275a7ae-bd39-469c-bffc-0db692f3a719 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:31.537471 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8275a7ae-bd39-469c-bffc-0db692f3a719 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:31.537471 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8275a7ae-bd39-469c-bffc-0db692f3a719 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:31.537811 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8275a7ae-bd39-469c-bffc-0db692f3a719 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:31.596886 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-8275a7ae-bd39-469c-bffc-0db692f3a719 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:29:31.604620 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-8275a7ae-bd39-469c-bffc-0db692f3a719 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1241 microversion: 2.1 time: 0.083559 Oct 26 11:29:31.605210 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 520/1026] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:29:31 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:29:32.628335 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-3c0f74a8-2d9c-4a3e-bee2-603502aa3dfc tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:29:32.628868 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-3c0f74a8-2d9c-4a3e-bee2-603502aa3dfc tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:29:32.635210 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3c0f74a8-2d9c-4a3e-bee2-603502aa3dfc tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:32.635695 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3c0f74a8-2d9c-4a3e-bee2-603502aa3dfc tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:32.636134 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3c0f74a8-2d9c-4a3e-bee2-603502aa3dfc tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:32.636823 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3c0f74a8-2d9c-4a3e-bee2-603502aa3dfc tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:32.637277 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3c0f74a8-2d9c-4a3e-bee2-603502aa3dfc tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:32.637703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3c0f74a8-2d9c-4a3e-bee2-603502aa3dfc tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:32.700745 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-3c0f74a8-2d9c-4a3e-bee2-603502aa3dfc tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:29:32.709155 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-3c0f74a8-2d9c-4a3e-bee2-603502aa3dfc tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1289 microversion: 2.1 time: 0.085248 Oct 26 11:29:32.709731 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 507/1027] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:29:32 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1289 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:29:33.733831 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-b468a127-6a65-493c-800f-18b14f76cca7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:29:33.735377 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-b468a127-6a65-493c-800f-18b14f76cca7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:29:33.753558 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b468a127-6a65-493c-800f-18b14f76cca7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:33.753558 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b468a127-6a65-493c-800f-18b14f76cca7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:33.753558 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b468a127-6a65-493c-800f-18b14f76cca7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:33.753558 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b468a127-6a65-493c-800f-18b14f76cca7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:33.753916 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b468a127-6a65-493c-800f-18b14f76cca7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:33.753916 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b468a127-6a65-493c-800f-18b14f76cca7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:33.901961 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-b468a127-6a65-493c-800f-18b14f76cca7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:29:33.910509 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-b468a127-6a65-493c-800f-18b14f76cca7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1363 microversion: 2.1 time: 0.181729 Oct 26 11:29:33.911293 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 521/1028] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:29:33 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:29:34.674553 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-27565e2f-11b4-4cc3-8ccd-892153d581a5 req-d8c16a5c-602c-4fdf-8bc3-d81cb2a581ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3", "tag": "569a0fe4-a190-486a-8d3b-deed1812804c"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:29:34.684225 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-27565e2f-11b4-4cc3-8ccd-892153d581a5 req-d8c16a5c-602c-4fdf-8bc3-d81cb2a581ae service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:34.684703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-27565e2f-11b4-4cc3-8ccd-892153d581a5 req-d8c16a5c-602c-4fdf-8bc3-d81cb2a581ae service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:34.685130 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-27565e2f-11b4-4cc3-8ccd-892153d581a5 req-d8c16a5c-602c-4fdf-8bc3-d81cb2a581ae service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:34.696092 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-27565e2f-11b4-4cc3-8ccd-892153d581a5 req-d8c16a5c-602c-4fdf-8bc3-d81cb2a581ae service nova] Creating event network-changed:569a0fe4-a190-486a-8d3b-deed1812804c for instance bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 on hv-cinder-81558 Oct 26 11:29:34.701010 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-27565e2f-11b4-4cc3-8ccd-892153d581a5 req-d8c16a5c-602c-4fdf-8bc3-d81cb2a581ae service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030895 Oct 26 11:29:34.701601 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 508/1029] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:29:34.935692 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-5b52b5d4-5193-4124-9a51-e577b503cd43 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:29:34.936868 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-5b52b5d4-5193-4124-9a51-e577b503cd43 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:29:34.943213 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5b52b5d4-5193-4124-9a51-e577b503cd43 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:34.943693 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5b52b5d4-5193-4124-9a51-e577b503cd43 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:34.944121 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5b52b5d4-5193-4124-9a51-e577b503cd43 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:34.944811 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5b52b5d4-5193-4124-9a51-e577b503cd43 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:34.945253 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5b52b5d4-5193-4124-9a51-e577b503cd43 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:34.945669 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5b52b5d4-5193-4124-9a51-e577b503cd43 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:35.081120 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-5b52b5d4-5193-4124-9a51-e577b503cd43 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:29:35.088864 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-5b52b5d4-5193-4124-9a51-e577b503cd43 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1363 microversion: 2.1 time: 0.157172 Oct 26 11:29:35.089451 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 522/1030] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:29:34 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:29:36.112170 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-75b1967a-e55e-42b3-ba60-7a57c8048b9c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:29:36.112868 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-75b1967a-e55e-42b3-ba60-7a57c8048b9c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:29:36.118899 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-75b1967a-e55e-42b3-ba60-7a57c8048b9c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:36.119381 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-75b1967a-e55e-42b3-ba60-7a57c8048b9c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:36.119816 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-75b1967a-e55e-42b3-ba60-7a57c8048b9c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:36.120501 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-75b1967a-e55e-42b3-ba60-7a57c8048b9c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:36.120951 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-75b1967a-e55e-42b3-ba60-7a57c8048b9c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:36.121374 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-75b1967a-e55e-42b3-ba60-7a57c8048b9c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:36.255725 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-75b1967a-e55e-42b3-ba60-7a57c8048b9c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:29:36.263324 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-75b1967a-e55e-42b3-ba60-7a57c8048b9c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1363 microversion: 2.1 time: 0.155841 Oct 26 11:29:36.263884 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 509/1031] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:29:36 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:29:37.285992 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-50fd889f-216c-4986-b92a-f3c2122f70a4 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:29:37.286596 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-50fd889f-216c-4986-b92a-f3c2122f70a4 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:29:37.292712 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-50fd889f-216c-4986-b92a-f3c2122f70a4 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:37.293193 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-50fd889f-216c-4986-b92a-f3c2122f70a4 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:37.293636 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-50fd889f-216c-4986-b92a-f3c2122f70a4 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:37.294327 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-50fd889f-216c-4986-b92a-f3c2122f70a4 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:37.294782 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-50fd889f-216c-4986-b92a-f3c2122f70a4 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:37.295226 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-50fd889f-216c-4986-b92a-f3c2122f70a4 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:37.425211 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-50fd889f-216c-4986-b92a-f3c2122f70a4 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:29:37.432766 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-50fd889f-216c-4986-b92a-f3c2122f70a4 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1363 microversion: 2.1 time: 0.151261 Oct 26 11:29:37.433335 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 523/1032] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:29:37 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:29:38.455316 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-6443fe7b-c73d-47a9-89fd-e69a2a15de5d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:29:38.455930 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-6443fe7b-c73d-47a9-89fd-e69a2a15de5d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:29:38.462574 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6443fe7b-c73d-47a9-89fd-e69a2a15de5d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:38.463093 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6443fe7b-c73d-47a9-89fd-e69a2a15de5d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:38.463530 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6443fe7b-c73d-47a9-89fd-e69a2a15de5d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:38.464223 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6443fe7b-c73d-47a9-89fd-e69a2a15de5d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:38.464674 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6443fe7b-c73d-47a9-89fd-e69a2a15de5d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:38.465094 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6443fe7b-c73d-47a9-89fd-e69a2a15de5d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:38.596360 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-6443fe7b-c73d-47a9-89fd-e69a2a15de5d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:29:38.603973 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-6443fe7b-c73d-47a9-89fd-e69a2a15de5d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1363 microversion: 2.1 time: 0.152597 Oct 26 11:29:38.604532 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 510/1033] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:29:38 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:29:39.627925 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-ae92593b-17c7-41a7-a35a-fa385649e202 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:29:39.628559 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-ae92593b-17c7-41a7-a35a-fa385649e202 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:29:39.634955 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ae92593b-17c7-41a7-a35a-fa385649e202 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:39.635437 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ae92593b-17c7-41a7-a35a-fa385649e202 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:39.635871 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ae92593b-17c7-41a7-a35a-fa385649e202 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:39.636585 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ae92593b-17c7-41a7-a35a-fa385649e202 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:39.637043 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ae92593b-17c7-41a7-a35a-fa385649e202 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:39.637466 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ae92593b-17c7-41a7-a35a-fa385649e202 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:39.766013 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ae92593b-17c7-41a7-a35a-fa385649e202 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:29:39.773799 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-ae92593b-17c7-41a7-a35a-fa385649e202 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1363 microversion: 2.1 time: 0.150014 Oct 26 11:29:39.774361 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 524/1034] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:29:39 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:29:40.796198 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a36a8657-9c29-4305-a7d5-31aec5db11f8 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:29:40.796805 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-a36a8657-9c29-4305-a7d5-31aec5db11f8 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:29:40.799207 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell0:SELECT=6 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:29:40.803847 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a36a8657-9c29-4305-a7d5-31aec5db11f8 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:40.804328 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a36a8657-9c29-4305-a7d5-31aec5db11f8 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:40.804755 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a36a8657-9c29-4305-a7d5-31aec5db11f8 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:40.805435 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a36a8657-9c29-4305-a7d5-31aec5db11f8 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:40.805883 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a36a8657-9c29-4305-a7d5-31aec5db11f8 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:40.806306 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a36a8657-9c29-4305-a7d5-31aec5db11f8 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:40.931994 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-a36a8657-9c29-4305-a7d5-31aec5db11f8 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:29:40.940057 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-a36a8657-9c29-4305-a7d5-31aec5db11f8 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1363 microversion: 2.1 time: 0.147700 Oct 26 11:29:40.940626 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 511/1035] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:29:40 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:29:41.962294 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-0267546d-3447-4c86-b1f6-d1026a87acb5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:29:41.962945 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-0267546d-3447-4c86-b1f6-d1026a87acb5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:29:41.964777 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell0:SELECT=2 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:29:41.965449 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell0:SELECT=6 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:29:41.971589 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0267546d-3447-4c86-b1f6-d1026a87acb5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:41.972081 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0267546d-3447-4c86-b1f6-d1026a87acb5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:41.972511 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0267546d-3447-4c86-b1f6-d1026a87acb5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:41.973208 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0267546d-3447-4c86-b1f6-d1026a87acb5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:41.973660 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0267546d-3447-4c86-b1f6-d1026a87acb5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:41.974082 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0267546d-3447-4c86-b1f6-d1026a87acb5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:42.114374 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-0267546d-3447-4c86-b1f6-d1026a87acb5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:29:42.121977 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-0267546d-3447-4c86-b1f6-d1026a87acb5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1363 microversion: 2.1 time: 0.163602 Oct 26 11:29:42.122549 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 525/1036] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:29:41 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:29:43.145247 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-3c49a199-87ee-49f7-b969-e089e78e052d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:29:43.145860 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-3c49a199-87ee-49f7-b969-e089e78e052d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:29:43.152576 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3c49a199-87ee-49f7-b969-e089e78e052d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:43.153066 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3c49a199-87ee-49f7-b969-e089e78e052d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:43.153501 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3c49a199-87ee-49f7-b969-e089e78e052d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:43.154192 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3c49a199-87ee-49f7-b969-e089e78e052d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:43.154646 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3c49a199-87ee-49f7-b969-e089e78e052d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:43.155106 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-3c49a199-87ee-49f7-b969-e089e78e052d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:43.285151 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-3c49a199-87ee-49f7-b969-e089e78e052d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:29:43.292787 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-3c49a199-87ee-49f7-b969-e089e78e052d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1363 microversion: 2.1 time: 0.151498 Oct 26 11:29:43.293351 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 512/1037] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:29:43 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:29:44.206580 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-7f9a2f2b-4e0a-427e-9593-b78a4026b0f6 req-ef2ab78f-5878-4a6d-be1e-8bb629623a9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3", "name": "network-vif-plugged", "status": "completed", "tag": "569a0fe4-a190-486a-8d3b-deed1812804c"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:29:44.215870 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-7f9a2f2b-4e0a-427e-9593-b78a4026b0f6 req-ef2ab78f-5878-4a6d-be1e-8bb629623a9b service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:44.216346 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-7f9a2f2b-4e0a-427e-9593-b78a4026b0f6 req-ef2ab78f-5878-4a6d-be1e-8bb629623a9b service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:44.216806 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-7f9a2f2b-4e0a-427e-9593-b78a4026b0f6 req-ef2ab78f-5878-4a6d-be1e-8bb629623a9b service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:44.228203 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-7f9a2f2b-4e0a-427e-9593-b78a4026b0f6 req-ef2ab78f-5878-4a6d-be1e-8bb629623a9b service nova] Creating event network-vif-plugged:569a0fe4-a190-486a-8d3b-deed1812804c for instance bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 on hv-cinder-81558 Oct 26 11:29:44.233119 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-7f9a2f2b-4e0a-427e-9593-b78a4026b0f6 req-ef2ab78f-5878-4a6d-be1e-8bb629623a9b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091903 Oct 26 11:29:44.233704 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 526/1038] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:29:44.315824 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-0c140979-a0ae-444b-88ab-1a6133cf70cf tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:29:44.317356 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-0c140979-a0ae-444b-88ab-1a6133cf70cf tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:29:44.322913 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0c140979-a0ae-444b-88ab-1a6133cf70cf tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:44.323400 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0c140979-a0ae-444b-88ab-1a6133cf70cf tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:44.323841 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0c140979-a0ae-444b-88ab-1a6133cf70cf tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:44.324539 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0c140979-a0ae-444b-88ab-1a6133cf70cf tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:44.324995 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0c140979-a0ae-444b-88ab-1a6133cf70cf tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:44.325420 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0c140979-a0ae-444b-88ab-1a6133cf70cf tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:44.457722 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-0c140979-a0ae-444b-88ab-1a6133cf70cf tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:29:44.465711 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-0c140979-a0ae-444b-88ab-1a6133cf70cf tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1363 microversion: 2.1 time: 0.153922 Oct 26 11:29:44.466291 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 513/1039] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:29:44 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:29:45.490114 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-fdeb62c4-c697-4412-add5-989e05b5a809 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:29:45.490997 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-fdeb62c4-c697-4412-add5-989e05b5a809 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:29:45.497154 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fdeb62c4-c697-4412-add5-989e05b5a809 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:45.497642 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fdeb62c4-c697-4412-add5-989e05b5a809 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:45.498075 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fdeb62c4-c697-4412-add5-989e05b5a809 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:45.498756 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fdeb62c4-c697-4412-add5-989e05b5a809 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:45.499233 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fdeb62c4-c697-4412-add5-989e05b5a809 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:45.499656 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fdeb62c4-c697-4412-add5-989e05b5a809 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:45.628113 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-fdeb62c4-c697-4412-add5-989e05b5a809 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:29:45.636080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-fdeb62c4-c697-4412-add5-989e05b5a809 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1363 microversion: 2.1 time: 0.151323 Oct 26 11:29:45.636650 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 527/1040] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:29:45 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:29:46.660515 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-640fff58-d535-41f3-b3b9-bc4be70423da tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:29:46.661126 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-640fff58-d535-41f3-b3b9-bc4be70423da tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:29:46.667585 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-640fff58-d535-41f3-b3b9-bc4be70423da tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:46.668069 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-640fff58-d535-41f3-b3b9-bc4be70423da tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:46.668506 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-640fff58-d535-41f3-b3b9-bc4be70423da tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:46.669214 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-640fff58-d535-41f3-b3b9-bc4be70423da tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:46.669668 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-640fff58-d535-41f3-b3b9-bc4be70423da tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:46.670090 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-640fff58-d535-41f3-b3b9-bc4be70423da tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:46.807628 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-640fff58-d535-41f3-b3b9-bc4be70423da tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:29:46.815277 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-640fff58-d535-41f3-b3b9-bc4be70423da tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1549 microversion: 2.1 time: 0.159178 Oct 26 11:29:46.815844 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 514/1041] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:29:46 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:29:46.838899 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-dbd511e1-902a-409f-a875-63803f8e69c7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:29:46.839437 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-dbd511e1-902a-409f-a875-63803f8e69c7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:29:46.846259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dbd511e1-902a-409f-a875-63803f8e69c7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:46.846731 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dbd511e1-902a-409f-a875-63803f8e69c7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:46.847182 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dbd511e1-902a-409f-a875-63803f8e69c7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:46.847890 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dbd511e1-902a-409f-a875-63803f8e69c7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:46.848335 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dbd511e1-902a-409f-a875-63803f8e69c7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:46.848792 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dbd511e1-902a-409f-a875-63803f8e69c7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:46.933040 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-dbd511e1-902a-409f-a875-63803f8e69c7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098085 Oct 26 11:29:46.933714 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 528/1042] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Oct 26 11:29:46 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:29:48.098343 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-f4a0f550-313a-424f-ba28-4ea04f12c70a req-6e2a031f-ac12-4ec5-9828-e09f787b877f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3", "tag": "569a0fe4-a190-486a-8d3b-deed1812804c"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:29:48.107867 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-f4a0f550-313a-424f-ba28-4ea04f12c70a req-6e2a031f-ac12-4ec5-9828-e09f787b877f service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:29:48.108824 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-f4a0f550-313a-424f-ba28-4ea04f12c70a req-6e2a031f-ac12-4ec5-9828-e09f787b877f service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:29:48.109327 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-f4a0f550-313a-424f-ba28-4ea04f12c70a req-6e2a031f-ac12-4ec5-9828-e09f787b877f service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:29:48.122190 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-f4a0f550-313a-424f-ba28-4ea04f12c70a req-6e2a031f-ac12-4ec5-9828-e09f787b877f service nova] Creating event network-changed:569a0fe4-a190-486a-8d3b-deed1812804c for instance bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 on hv-cinder-81558 Oct 26 11:29:48.128189 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-f4a0f550-313a-424f-ba28-4ea04f12c70a req-6e2a031f-ac12-4ec5-9828-e09f787b877f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165678 Oct 26 11:29:48.128799 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 515/1043] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:30:03.158228 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-ec9aa727-9e5c-4878-be2a-3ba8217d172b tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:03.159118 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-ec9aa727-9e5c-4878-be2a-3ba8217d172b tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:03.159769 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-268be6e3-d7e8-486a-8e6d-fbdd1f68cd54 req-94858cf3-29c7-4df8-a1da-e8b6ecc60ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aba99081-fcee-4a22-80e9-7c08f92a03d2", "tag": "5b41cdbe-3c75-436a-bb3e-d85764fc830a"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:30:03.166394 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:30:03.168451 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:30:03.169108 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=50 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:30:03.174612 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ec9aa727-9e5c-4878-be2a-3ba8217d172b tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:03.175122 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ec9aa727-9e5c-4878-be2a-3ba8217d172b tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:03.176288 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=46 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:30:03.177083 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 11:30:03.177360 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Wed Oct 26 11:30:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.42) !!! Oct 26 11:30:03.179412 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ec9aa727-9e5c-4878-be2a-3ba8217d172b tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:03.180131 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ec9aa727-9e5c-4878-be2a-3ba8217d172b tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:03.180594 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ec9aa727-9e5c-4878-be2a-3ba8217d172b tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:03.184939 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ec9aa727-9e5c-4878-be2a-3ba8217d172b tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:03.196355 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-268be6e3-d7e8-486a-8e6d-fbdd1f68cd54 req-94858cf3-29c7-4df8-a1da-e8b6ecc60ad2 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:03.197322 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-268be6e3-d7e8-486a-8e6d-fbdd1f68cd54 req-94858cf3-29c7-4df8-a1da-e8b6ecc60ad2 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:03.208333 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-268be6e3-d7e8-486a-8e6d-fbdd1f68cd54 req-94858cf3-29c7-4df8-a1da-e8b6ecc60ad2 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:03.216699 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-ec9aa727-9e5c-4878-be2a-3ba8217d172b tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Going to try to terminate instance {{(pid=119306) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 11:30:03.221578 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-268be6e3-d7e8-486a-8e6d-fbdd1f68cd54 req-94858cf3-29c7-4df8-a1da-e8b6ecc60ad2 service nova] Creating event network-changed:5b41cdbe-3c75-436a-bb3e-d85764fc830a for instance aba99081-fcee-4a22-80e9-7c08f92a03d2 on hv-cinder-81558 Oct 26 11:30:03.226957 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-268be6e3-d7e8-486a-8e6d-fbdd1f68cd54 req-94858cf3-29c7-4df8-a1da-e8b6ecc60ad2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076110 Oct 26 11:30:03.230811 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 516/1044] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:30:03.529901 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-ec9aa727-9e5c-4878-be2a-3ba8217d172b tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "DELETE /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2" status: 204 len: 0 microversion: 2.1 time: 0.386641 Oct 26 11:30:03.531916 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 529/1045] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Oct 26 11:30:03 2022] DELETE /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 11:30:03.545987 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-fb0293c4-ea9c-4c3a-9cce-6180e2b3a463 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:03.547810 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-fb0293c4-ea9c-4c3a-9cce-6180e2b3a463 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:03.556839 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fb0293c4-ea9c-4c3a-9cce-6180e2b3a463 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:03.557411 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fb0293c4-ea9c-4c3a-9cce-6180e2b3a463 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:03.558053 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fb0293c4-ea9c-4c3a-9cce-6180e2b3a463 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:03.558769 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fb0293c4-ea9c-4c3a-9cce-6180e2b3a463 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:03.559276 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fb0293c4-ea9c-4c3a-9cce-6180e2b3a463 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:03.559736 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fb0293c4-ea9c-4c3a-9cce-6180e2b3a463 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:03.702508 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-fb0293c4-ea9c-4c3a-9cce-6180e2b3a463 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:30:03.709544 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-fb0293c4-ea9c-4c3a-9cce-6180e2b3a463 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2" status: 200 len: 1578 microversion: 2.1 time: 0.173348 Oct 26 11:30:03.710842 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 517/1046] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:03 2022] GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:30:04.734685 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-7cfbf151-b80b-4c9e-9387-bfaf597c88fd tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:04.735412 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-7cfbf151-b80b-4c9e-9387-bfaf597c88fd tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:04.743071 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7cfbf151-b80b-4c9e-9387-bfaf597c88fd tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:04.743849 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7cfbf151-b80b-4c9e-9387-bfaf597c88fd tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:04.744293 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7cfbf151-b80b-4c9e-9387-bfaf597c88fd tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:04.745006 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7cfbf151-b80b-4c9e-9387-bfaf597c88fd tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:04.745463 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7cfbf151-b80b-4c9e-9387-bfaf597c88fd tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:04.745887 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7cfbf151-b80b-4c9e-9387-bfaf597c88fd tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:04.893265 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-7cfbf151-b80b-4c9e-9387-bfaf597c88fd tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:30:04.905388 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-7cfbf151-b80b-4c9e-9387-bfaf597c88fd tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2" status: 200 len: 1578 microversion: 2.1 time: 0.175426 Oct 26 11:30:04.906438 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 530/1047] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:04 2022] GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 => generated 1578 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:30:05.929884 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-ad19b012-6ec7-469e-8c45-417ab18d3a4a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:05.930502 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-ad19b012-6ec7-469e-8c45-417ab18d3a4a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:05.936980 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ad19b012-6ec7-469e-8c45-417ab18d3a4a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:05.937787 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ad19b012-6ec7-469e-8c45-417ab18d3a4a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:05.938238 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ad19b012-6ec7-469e-8c45-417ab18d3a4a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:05.938979 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ad19b012-6ec7-469e-8c45-417ab18d3a4a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:05.939456 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ad19b012-6ec7-469e-8c45-417ab18d3a4a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:05.940007 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ad19b012-6ec7-469e-8c45-417ab18d3a4a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:06.028786 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-ad19b012-6ec7-469e-8c45-417ab18d3a4a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:30:06.043989 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-ad19b012-6ec7-469e-8c45-417ab18d3a4a tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2" status: 200 len: 1392 microversion: 2.1 time: 0.118300 Oct 26 11:30:06.044591 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 518/1048] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:05 2022] GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 => generated 1392 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:30:06.089208 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-633f34a1-c092-456d-a913-6f7bd60c5ae6 req-73cca94f-e2d0-46a8-98d9-477d8020a34b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aba99081-fcee-4a22-80e9-7c08f92a03d2", "name": "network-vif-deleted", "tag": "5b41cdbe-3c75-436a-bb3e-d85764fc830a"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:30:06.099028 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-633f34a1-c092-456d-a913-6f7bd60c5ae6 req-73cca94f-e2d0-46a8-98d9-477d8020a34b service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:06.099506 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-633f34a1-c092-456d-a913-6f7bd60c5ae6 req-73cca94f-e2d0-46a8-98d9-477d8020a34b service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:06.099933 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-633f34a1-c092-456d-a913-6f7bd60c5ae6 req-73cca94f-e2d0-46a8-98d9-477d8020a34b service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:06.110647 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-633f34a1-c092-456d-a913-6f7bd60c5ae6 req-73cca94f-e2d0-46a8-98d9-477d8020a34b service nova] Creating event network-vif-deleted:5b41cdbe-3c75-436a-bb3e-d85764fc830a for instance aba99081-fcee-4a22-80e9-7c08f92a03d2 on hv-cinder-81558 Oct 26 11:30:06.116322 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-633f34a1-c092-456d-a913-6f7bd60c5ae6 req-73cca94f-e2d0-46a8-98d9-477d8020a34b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030591 Oct 26 11:30:06.116925 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 531/1049] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:30:07.067431 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-2e4918a8-cf3b-4b58-8404-49e3c35fff83 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:07.068026 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-2e4918a8-cf3b-4b58-8404-49e3c35fff83 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:07.074431 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2e4918a8-cf3b-4b58-8404-49e3c35fff83 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:07.074926 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2e4918a8-cf3b-4b58-8404-49e3c35fff83 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:07.075363 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2e4918a8-cf3b-4b58-8404-49e3c35fff83 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:07.076053 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2e4918a8-cf3b-4b58-8404-49e3c35fff83 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:07.076504 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2e4918a8-cf3b-4b58-8404-49e3c35fff83 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:07.076921 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2e4918a8-cf3b-4b58-8404-49e3c35fff83 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:07.108548 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2e4918a8-cf3b-4b58-8404-49e3c35fff83 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:07.109038 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2e4918a8-cf3b-4b58-8404-49e3c35fff83 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:07.109486 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2e4918a8-cf3b-4b58-8404-49e3c35fff83 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:07.109931 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.objects.instance [None req-2e4918a8-cf3b-4b58-8404-49e3c35fff83 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lazy-loading 'fault' on Instance uuid aba99081-fcee-4a22-80e9-7c08f92a03d2 {{(pid=119305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:30:07.151438 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-2e4918a8-cf3b-4b58-8404-49e3c35fff83 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:30:07.159593 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-2e4918a8-cf3b-4b58-8404-49e3c35fff83 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2" status: 200 len: 1231 microversion: 2.1 time: 0.096020 Oct 26 11:30:07.160166 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 519/1050] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:07 2022] GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 => generated 1231 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:30:08.185221 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-2be75d8f-37b6-4808-a5a3-3ee97daf976d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:08.185944 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-2be75d8f-37b6-4808-a5a3-3ee97daf976d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: aba99081-fcee-4a22-80e9-7c08f92a03d2] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:08.192784 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2be75d8f-37b6-4808-a5a3-3ee97daf976d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:08.193263 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2be75d8f-37b6-4808-a5a3-3ee97daf976d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:08.193694 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2be75d8f-37b6-4808-a5a3-3ee97daf976d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:08.194373 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2be75d8f-37b6-4808-a5a3-3ee97daf976d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:08.194944 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2be75d8f-37b6-4808-a5a3-3ee97daf976d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:08.195364 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2be75d8f-37b6-4808-a5a3-3ee97daf976d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:08.208753 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.wsgi [None req-2be75d8f-37b6-4808-a5a3-3ee97daf976d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] HTTP exception thrown: Instance aba99081-fcee-4a22-80e9-7c08f92a03d2 could not be found. Oct 26 11:30:08.210355 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-2be75d8f-37b6-4808-a5a3-3ee97daf976d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Request method failure captured: Oct 26 11:30:08.210355 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: request: GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 HTTP/1.1 Oct 26 11:30:08.210355 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept: application/json Oct 26 11:30:08.210355 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept-Encoding: identity Oct 26 11:30:08.210355 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Connection: close Oct 26 11:30:08.210355 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Length: 0 Oct 26 11:30:08.210355 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Type: application/json Oct 26 11:30:08.210355 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Host: 10.222.0.42 Oct 26 11:30:08.210355 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Openstack-System-Scope: None Oct 26 11:30:08.210355 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: User-Agent: python-urllib3/1.26.12 Oct 26 11:30:08.210355 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Auth-Token: gAAAAABjWRfbNpLZi4ehhxinHzLyHLguE5bpFXyCWdRz5wd7E74tg5HJJVRv8clONT6afl62Z2NRVo1fiUn-KTV4H_DhWPuGUFCfoQrS_hwunB25OMgryWhVgNo60E55f4dNNrihSGeHFIG2avl9kOUBSXoh15kKR-UWP7pL6h0FZziiSUbeMH8 Oct 26 11:30:08.210355 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Id: None Oct 26 11:30:08.210355 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Name: None Oct 26 11:30:08.210355 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Identity-Status: Confirmed Oct 26 11:30:08.210355 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Is-Admin-Project: True Oct 26 11:30:08.210355 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Id: default Oct 26 11:30:08.210355 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Name: Default Oct 26 11:30:08.210355 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Id: e378bfab9d91492e81320139fed867c6 Oct 26 11:30:08.210355 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Name: tempest-TestVolumeBootPattern-2087611894 Oct 26 11:30:08.210355 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Role: member,reader Oct 26 11:30:08.210355 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Roles: member,reader Oct 26 11:30:08.211904 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e378bfab9d91492e81320139fed867c6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e378bfab9d91492e81320139fed867c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e378bfab9d91492e81320139fed867c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e378bfab9d91492e81320139fed867c6"}]}] Oct 26 11:30:08.211904 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant: tempest-TestVolumeBootPattern-2087611894 Oct 26 11:30:08.211904 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Id: e378bfab9d91492e81320139fed867c6 Oct 26 11:30:08.211904 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Name: tempest-TestVolumeBootPattern-2087611894 Oct 26 11:30:08.211904 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User: tempest-TestVolumeBootPattern-2087611894-project Oct 26 11:30:08.211904 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Id: default Oct 26 11:30:08.211904 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Name: Default Oct 26 11:30:08.211904 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Id: 1f737b4d0531425cbc803fcd15a3ea1f Oct 26 11:30:08.211904 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Name: tempest-TestVolumeBootPattern-2087611894-project Oct 26 11:30:08.211904 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: method: > Oct 26 11:30:08.211904 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: exception: Instance aba99081-fcee-4a22-80e9-7c08f92a03d2 could not be found. Oct 26 11:30:08.211904 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: action_args: {'id': 'aba99081-fcee-4a22-80e9-7c08f92a03d2'} Oct 26 11:30:08.212774 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:30:08.212774 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:30:08.212774 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:30:08.212774 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:30:08.212774 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:30:08.212774 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:30:08.212774 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:30:08.212774 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:30:08.212774 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:30:08.212774 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:30:08.212774 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aba99081-fcee-4a22-80e9-7c08f92a03d2 could not be found. Oct 26 11:30:08.212774 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:30:08.212774 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:30:08.212774 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:30:08.212774 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:30:08.212774 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:30:08.212774 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:30:08.212774 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:30:08.212774 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:30:08.212774 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:30:08.214599 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:30:08.214599 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 11:30:08.214599 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 11:30:08.214599 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:30:08.214599 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:30:08.214599 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:30:08.214599 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:30:08.214599 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aba99081-fcee-4a22-80e9-7c08f92a03d2 could not be found. Oct 26 11:30:08.214599 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:30:08.214599 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:30:08.214599 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:30:08.214599 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:30:08.214599 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:30:08.214599 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:30:08.214599 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:30:08.214599 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:30:08.214599 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aba99081-fcee-4a22-80e9-7c08f92a03d2 could not be found. Oct 26 11:30:08.214599 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:30:08.216231 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-2be75d8f-37b6-4808-a5a3-3ee97daf976d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Returning 404 to user: Instance aba99081-fcee-4a22-80e9-7c08f92a03d2 could not be found. {{(pid=119306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:30:08.216231 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-2be75d8f-37b6-4808-a5a3-3ee97daf976d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2" status: 404 len: 111 microversion: 2.1 time: 0.031332 Oct 26 11:30:08.216231 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 532/1051] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:08 2022] GET /compute/v2.1/servers/aba99081-fcee-4a22-80e9-7c08f92a03d2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:30:11.967002 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-61724dbd-1345-4a3f-a46a-53b340a302e8 req-cfec9793-b890-4957-83da-bd22d70cc2d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "357ae7de-daf6-4dac-9370-1351f0fab0c6", "tag": "4098a34c-ed38-40c7-a957-cd9dc982a278"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:30:11.967002 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-61724dbd-1345-4a3f-a46a-53b340a302e8 req-cfec9793-b890-4957-83da-bd22d70cc2d0 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:11.967002 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-61724dbd-1345-4a3f-a46a-53b340a302e8 req-cfec9793-b890-4957-83da-bd22d70cc2d0 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:11.967002 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-61724dbd-1345-4a3f-a46a-53b340a302e8 req-cfec9793-b890-4957-83da-bd22d70cc2d0 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:11.968389 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-61724dbd-1345-4a3f-a46a-53b340a302e8 req-cfec9793-b890-4957-83da-bd22d70cc2d0 service nova] Creating event network-changed:4098a34c-ed38-40c7-a957-cd9dc982a278 for instance 357ae7de-daf6-4dac-9370-1351f0fab0c6 on hv-cinder-81558 Oct 26 11:30:11.968389 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-61724dbd-1345-4a3f-a46a-53b340a302e8 req-cfec9793-b890-4957-83da-bd22d70cc2d0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036911 Oct 26 11:30:11.968389 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 520/1052] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:30:11.968721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-9dbbb7e5-5a13-46a1-89da-89330de3da6c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:11.968721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-9dbbb7e5-5a13-46a1-89da-89330de3da6c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 357ae7de-daf6-4dac-9370-1351f0fab0c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:11.968721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9dbbb7e5-5a13-46a1-89da-89330de3da6c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:11.968721 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9dbbb7e5-5a13-46a1-89da-89330de3da6c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:11.969301 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9dbbb7e5-5a13-46a1-89da-89330de3da6c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:11.969301 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9dbbb7e5-5a13-46a1-89da-89330de3da6c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:11.969301 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9dbbb7e5-5a13-46a1-89da-89330de3da6c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:11.969301 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9dbbb7e5-5a13-46a1-89da-89330de3da6c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:11.969603 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-9dbbb7e5-5a13-46a1-89da-89330de3da6c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 357ae7de-daf6-4dac-9370-1351f0fab0c6] Going to try to terminate instance {{(pid=119306) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 11:30:12.334931 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-9dbbb7e5-5a13-46a1-89da-89330de3da6c tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "DELETE /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6" status: 204 len: 0 microversion: 2.1 time: 0.438608 Oct 26 11:30:12.334931 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 533/1053] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Oct 26 11:30:11 2022] DELETE /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 11:30:12.341666 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-034294dd-c965-42c1-a6bb-ba3c17739384 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:12.342369 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-034294dd-c965-42c1-a6bb-ba3c17739384 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 357ae7de-daf6-4dac-9370-1351f0fab0c6] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:12.349098 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-034294dd-c965-42c1-a6bb-ba3c17739384 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:12.349587 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-034294dd-c965-42c1-a6bb-ba3c17739384 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:12.350024 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-034294dd-c965-42c1-a6bb-ba3c17739384 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:12.350729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-034294dd-c965-42c1-a6bb-ba3c17739384 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:12.351234 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-034294dd-c965-42c1-a6bb-ba3c17739384 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:12.351847 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-034294dd-c965-42c1-a6bb-ba3c17739384 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:12.488415 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-034294dd-c965-42c1-a6bb-ba3c17739384 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:30:12.496491 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-034294dd-c965-42c1-a6bb-ba3c17739384 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6" status: 200 len: 1578 microversion: 2.1 time: 0.159433 Oct 26 11:30:12.500730 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 521/1054] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:12 2022] GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:30:13.027688 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-8317c4d1-dc1a-48a3-ab5e-1af322f36fbc tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:30:13.029996 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-8317c4d1-dc1a-48a3-ab5e-1af322f36fbc tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:13.036380 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8317c4d1-dc1a-48a3-ab5e-1af322f36fbc tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:13.036866 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8317c4d1-dc1a-48a3-ab5e-1af322f36fbc tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:13.037298 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8317c4d1-dc1a-48a3-ab5e-1af322f36fbc tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:13.037990 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8317c4d1-dc1a-48a3-ab5e-1af322f36fbc tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:13.038435 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8317c4d1-dc1a-48a3-ab5e-1af322f36fbc tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:13.038876 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8317c4d1-dc1a-48a3-ab5e-1af322f36fbc tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:13.272580 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-8317c4d1-dc1a-48a3-ab5e-1af322f36fbc tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "POST /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5/action" status: 202 len: 0 microversion: 2.1 time: 0.249313 Oct 26 11:30:13.273286 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 534/1055] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Oct 26 11:30:13 2022] POST /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 11:30:13.283009 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-16c9dab4-f001-4dad-b342-03afe09e0533 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:13.283595 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-16c9dab4-f001-4dad-b342-03afe09e0533 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:13.290137 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-16c9dab4-f001-4dad-b342-03afe09e0533 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:13.290616 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-16c9dab4-f001-4dad-b342-03afe09e0533 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:13.291068 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-16c9dab4-f001-4dad-b342-03afe09e0533 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:13.291759 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-16c9dab4-f001-4dad-b342-03afe09e0533 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:13.292215 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-16c9dab4-f001-4dad-b342-03afe09e0533 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:13.292622 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-16c9dab4-f001-4dad-b342-03afe09e0533 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:13.476825 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-16c9dab4-f001-4dad-b342-03afe09e0533 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:30:13.486051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-16c9dab4-f001-4dad-b342-03afe09e0533 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1752 microversion: 2.1 time: 0.208236 Oct 26 11:30:13.488363 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 522/1056] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:13 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1752 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:30:13.521675 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-da7f0b18-b410-4b67-aff0-6bbe688c707f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:13.522669 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-da7f0b18-b410-4b67-aff0-6bbe688c707f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 357ae7de-daf6-4dac-9370-1351f0fab0c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:13.531181 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-da7f0b18-b410-4b67-aff0-6bbe688c707f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:13.531884 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-da7f0b18-b410-4b67-aff0-6bbe688c707f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:13.533165 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-da7f0b18-b410-4b67-aff0-6bbe688c707f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:13.534139 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-da7f0b18-b410-4b67-aff0-6bbe688c707f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:13.534609 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-da7f0b18-b410-4b67-aff0-6bbe688c707f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:13.535409 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-da7f0b18-b410-4b67-aff0-6bbe688c707f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:14.011469 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-5ee8f9d7-8a7e-4f58-8a7e-34996c545814 req-16817ce4-591d-484b-991c-f42c2653480b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "357ae7de-daf6-4dac-9370-1351f0fab0c6", "name": "network-vif-deleted", "tag": "4098a34c-ed38-40c7-a957-cd9dc982a278"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:30:14.022856 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-5ee8f9d7-8a7e-4f58-8a7e-34996c545814 req-16817ce4-591d-484b-991c-f42c2653480b service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:14.023577 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-5ee8f9d7-8a7e-4f58-8a7e-34996c545814 req-16817ce4-591d-484b-991c-f42c2653480b service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:14.024323 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-5ee8f9d7-8a7e-4f58-8a7e-34996c545814 req-16817ce4-591d-484b-991c-f42c2653480b service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:14.037182 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-5ee8f9d7-8a7e-4f58-8a7e-34996c545814 req-16817ce4-591d-484b-991c-f42c2653480b service nova] Creating event network-vif-deleted:4098a34c-ed38-40c7-a957-cd9dc982a278 for instance 357ae7de-daf6-4dac-9370-1351f0fab0c6 on hv-cinder-81558 Oct 26 11:30:14.046464 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-da7f0b18-b410-4b67-aff0-6bbe688c707f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:30:14.055466 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-5ee8f9d7-8a7e-4f58-8a7e-34996c545814 req-16817ce4-591d-484b-991c-f42c2653480b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048716 Oct 26 11:30:14.056356 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 523/1057] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:30:14.057953 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-da7f0b18-b410-4b67-aff0-6bbe688c707f tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6" status: 200 len: 1460 microversion: 2.1 time: 0.541413 Oct 26 11:30:14.058985 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 535/1058] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:13 2022] GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6 => generated 1460 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:30:14.517380 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-03c8a4eb-c1af-4bb7-ae41-2a24c4190856 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:14.519606 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-03c8a4eb-c1af-4bb7-ae41-2a24c4190856 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:14.526279 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-03c8a4eb-c1af-4bb7-ae41-2a24c4190856 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:14.526771 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-03c8a4eb-c1af-4bb7-ae41-2a24c4190856 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:14.527293 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-03c8a4eb-c1af-4bb7-ae41-2a24c4190856 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:14.528003 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-03c8a4eb-c1af-4bb7-ae41-2a24c4190856 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:14.528488 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-03c8a4eb-c1af-4bb7-ae41-2a24c4190856 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:14.529847 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-03c8a4eb-c1af-4bb7-ae41-2a24c4190856 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:14.708465 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-03c8a4eb-c1af-4bb7-ae41-2a24c4190856 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:30:14.718280 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-03c8a4eb-c1af-4bb7-ae41-2a24c4190856 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1752 microversion: 2.1 time: 0.206171 Oct 26 11:30:14.719131 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 524/1059] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:14 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1752 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:30:15.081655 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-082edea8-5b93-428d-b8b5-da78d944217d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:15.083249 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-082edea8-5b93-428d-b8b5-da78d944217d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 357ae7de-daf6-4dac-9370-1351f0fab0c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:15.089196 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-082edea8-5b93-428d-b8b5-da78d944217d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:15.089881 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-082edea8-5b93-428d-b8b5-da78d944217d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:15.090505 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-082edea8-5b93-428d-b8b5-da78d944217d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:15.091397 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-082edea8-5b93-428d-b8b5-da78d944217d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:15.092012 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-082edea8-5b93-428d-b8b5-da78d944217d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:15.092594 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-082edea8-5b93-428d-b8b5-da78d944217d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:15.129249 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-082edea8-5b93-428d-b8b5-da78d944217d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:15.129712 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-082edea8-5b93-428d-b8b5-da78d944217d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:15.130140 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-082edea8-5b93-428d-b8b5-da78d944217d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:15.130581 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.objects.instance [None req-082edea8-5b93-428d-b8b5-da78d944217d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lazy-loading 'fault' on Instance uuid 357ae7de-daf6-4dac-9370-1351f0fab0c6 {{(pid=119306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:30:15.171658 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-082edea8-5b93-428d-b8b5-da78d944217d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f737b4d0531425cbc803fcd15a3ea1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e378bfab9d91492e81320139fed867c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:30:15.180233 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-082edea8-5b93-428d-b8b5-da78d944217d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6" status: 200 len: 1230 microversion: 2.1 time: 0.102623 Oct 26 11:30:15.180829 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 536/1060] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:15 2022] GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6 => generated 1230 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:30:15.744948 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-287519cb-1a9c-45e8-a4ca-fb6b812d9a53 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:15.746160 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-287519cb-1a9c-45e8-a4ca-fb6b812d9a53 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:15.757976 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-287519cb-1a9c-45e8-a4ca-fb6b812d9a53 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:15.758093 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-287519cb-1a9c-45e8-a4ca-fb6b812d9a53 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:15.758541 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-287519cb-1a9c-45e8-a4ca-fb6b812d9a53 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:15.759285 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-287519cb-1a9c-45e8-a4ca-fb6b812d9a53 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:15.759737 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-287519cb-1a9c-45e8-a4ca-fb6b812d9a53 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:15.767531 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-287519cb-1a9c-45e8-a4ca-fb6b812d9a53 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:15.967354 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-287519cb-1a9c-45e8-a4ca-fb6b812d9a53 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:30:15.977450 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-287519cb-1a9c-45e8-a4ca-fb6b812d9a53 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1757 microversion: 2.1 time: 0.236264 Oct 26 11:30:15.979148 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 525/1061] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:15 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1757 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:30:16.203036 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-6f23eda4-0efc-42cb-be0a-569463ff3852 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:16.203581 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-6f23eda4-0efc-42cb-be0a-569463ff3852 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 357ae7de-daf6-4dac-9370-1351f0fab0c6] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:16.209972 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6f23eda4-0efc-42cb-be0a-569463ff3852 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:16.210571 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6f23eda4-0efc-42cb-be0a-569463ff3852 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:16.210966 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6f23eda4-0efc-42cb-be0a-569463ff3852 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:16.211665 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6f23eda4-0efc-42cb-be0a-569463ff3852 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:16.212103 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6f23eda4-0efc-42cb-be0a-569463ff3852 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:16.212523 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6f23eda4-0efc-42cb-be0a-569463ff3852 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:16.228506 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.wsgi [None req-6f23eda4-0efc-42cb-be0a-569463ff3852 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] HTTP exception thrown: Instance 357ae7de-daf6-4dac-9370-1351f0fab0c6 could not be found. Oct 26 11:30:16.229142 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-6f23eda4-0efc-42cb-be0a-569463ff3852 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Request method failure captured: Oct 26 11:30:16.229142 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: request: GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6 HTTP/1.1 Oct 26 11:30:16.229142 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept: application/json Oct 26 11:30:16.229142 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept-Encoding: identity Oct 26 11:30:16.229142 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Connection: close Oct 26 11:30:16.229142 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Length: 0 Oct 26 11:30:16.229142 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Type: application/json Oct 26 11:30:16.229142 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Host: 10.222.0.42 Oct 26 11:30:16.229142 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Openstack-System-Scope: None Oct 26 11:30:16.229142 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: User-Agent: python-urllib3/1.26.12 Oct 26 11:30:16.229142 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Auth-Token: gAAAAABjWRfbNpLZi4ehhxinHzLyHLguE5bpFXyCWdRz5wd7E74tg5HJJVRv8clONT6afl62Z2NRVo1fiUn-KTV4H_DhWPuGUFCfoQrS_hwunB25OMgryWhVgNo60E55f4dNNrihSGeHFIG2avl9kOUBSXoh15kKR-UWP7pL6h0FZziiSUbeMH8 Oct 26 11:30:16.229142 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Id: None Oct 26 11:30:16.229142 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Name: None Oct 26 11:30:16.229142 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Identity-Status: Confirmed Oct 26 11:30:16.229142 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Is-Admin-Project: True Oct 26 11:30:16.229142 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Id: default Oct 26 11:30:16.229142 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Name: Default Oct 26 11:30:16.229142 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Id: e378bfab9d91492e81320139fed867c6 Oct 26 11:30:16.229142 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Name: tempest-TestVolumeBootPattern-2087611894 Oct 26 11:30:16.229142 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Role: member,reader Oct 26 11:30:16.229142 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Roles: member,reader Oct 26 11:30:16.230838 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e378bfab9d91492e81320139fed867c6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e378bfab9d91492e81320139fed867c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e378bfab9d91492e81320139fed867c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e378bfab9d91492e81320139fed867c6"}]}] Oct 26 11:30:16.230838 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant: tempest-TestVolumeBootPattern-2087611894 Oct 26 11:30:16.230838 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Id: e378bfab9d91492e81320139fed867c6 Oct 26 11:30:16.230838 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Name: tempest-TestVolumeBootPattern-2087611894 Oct 26 11:30:16.230838 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User: tempest-TestVolumeBootPattern-2087611894-project Oct 26 11:30:16.230838 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Id: default Oct 26 11:30:16.230838 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Name: Default Oct 26 11:30:16.230838 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Id: 1f737b4d0531425cbc803fcd15a3ea1f Oct 26 11:30:16.230838 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Name: tempest-TestVolumeBootPattern-2087611894-project Oct 26 11:30:16.230838 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: method: > Oct 26 11:30:16.230838 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: exception: Instance 357ae7de-daf6-4dac-9370-1351f0fab0c6 could not be found. Oct 26 11:30:16.230838 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: action_args: {'id': '357ae7de-daf6-4dac-9370-1351f0fab0c6'} Oct 26 11:30:16.232297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:30:16.232297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:30:16.232297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:30:16.232297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:30:16.232297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:30:16.232297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:30:16.232297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:30:16.232297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:30:16.232297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:30:16.232297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:30:16.232297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 357ae7de-daf6-4dac-9370-1351f0fab0c6 could not be found. Oct 26 11:30:16.232297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:30:16.232297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:30:16.232297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:30:16.232297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:30:16.232297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:30:16.232297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:30:16.232297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:30:16.232297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:30:16.232297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:30:16.233624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:30:16.233624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 11:30:16.233624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 11:30:16.233624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:30:16.233624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:30:16.233624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:30:16.233624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:30:16.233624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 357ae7de-daf6-4dac-9370-1351f0fab0c6 could not be found. Oct 26 11:30:16.233624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:30:16.233624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:30:16.233624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:30:16.233624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:30:16.233624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:30:16.233624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:30:16.233624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:30:16.233624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:30:16.233624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 357ae7de-daf6-4dac-9370-1351f0fab0c6 could not be found. Oct 26 11:30:16.233624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:30:16.234961 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-6f23eda4-0efc-42cb-be0a-569463ff3852 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Returning 404 to user: Instance 357ae7de-daf6-4dac-9370-1351f0fab0c6 could not be found. {{(pid=119306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:30:16.234961 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-6f23eda4-0efc-42cb-be0a-569463ff3852 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6" status: 404 len: 111 microversion: 2.1 time: 0.031652 Oct 26 11:30:16.234961 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 537/1062] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:16 2022] GET /compute/v2.1/servers/357ae7de-daf6-4dac-9370-1351f0fab0c6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:30:16.800456 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-9644edef-7959-438e-ac1d-d9d189f04e3d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:16.801012 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-9644edef-7959-438e-ac1d-d9d189f04e3d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:16.807371 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9644edef-7959-438e-ac1d-d9d189f04e3d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:16.807852 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9644edef-7959-438e-ac1d-d9d189f04e3d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:16.808344 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9644edef-7959-438e-ac1d-d9d189f04e3d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:16.809040 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9644edef-7959-438e-ac1d-d9d189f04e3d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:16.809508 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9644edef-7959-438e-ac1d-d9d189f04e3d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:16.809909 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9644edef-7959-438e-ac1d-d9d189f04e3d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:16.823728 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.wsgi [None req-9644edef-7959-438e-ac1d-d9d189f04e3d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] HTTP exception thrown: Instance 1f64d1d1-56f2-4ec0-b93a-faceb3411d40 could not be found. Oct 26 11:30:16.825470 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-9644edef-7959-438e-ac1d-d9d189f04e3d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Request method failure captured: Oct 26 11:30:16.825470 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: request: DELETE /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 HTTP/1.1 Oct 26 11:30:16.825470 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept: application/json Oct 26 11:30:16.825470 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept-Encoding: identity Oct 26 11:30:16.825470 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Connection: close Oct 26 11:30:16.825470 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Length: 0 Oct 26 11:30:16.825470 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Type: application/json Oct 26 11:30:16.825470 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Host: 10.222.0.42 Oct 26 11:30:16.825470 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Openstack-System-Scope: None Oct 26 11:30:16.825470 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: User-Agent: python-urllib3/1.26.12 Oct 26 11:30:16.825470 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Auth-Token: gAAAAABjWRfbNpLZi4ehhxinHzLyHLguE5bpFXyCWdRz5wd7E74tg5HJJVRv8clONT6afl62Z2NRVo1fiUn-KTV4H_DhWPuGUFCfoQrS_hwunB25OMgryWhVgNo60E55f4dNNrihSGeHFIG2avl9kOUBSXoh15kKR-UWP7pL6h0FZziiSUbeMH8 Oct 26 11:30:16.825470 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Id: None Oct 26 11:30:16.825470 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Name: None Oct 26 11:30:16.825470 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Identity-Status: Confirmed Oct 26 11:30:16.825470 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Is-Admin-Project: True Oct 26 11:30:16.825470 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Id: default Oct 26 11:30:16.825470 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Name: Default Oct 26 11:30:16.825470 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Id: e378bfab9d91492e81320139fed867c6 Oct 26 11:30:16.825470 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Name: tempest-TestVolumeBootPattern-2087611894 Oct 26 11:30:16.825470 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Role: member,reader Oct 26 11:30:16.825470 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Roles: member,reader Oct 26 11:30:16.827090 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e378bfab9d91492e81320139fed867c6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e378bfab9d91492e81320139fed867c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e378bfab9d91492e81320139fed867c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e378bfab9d91492e81320139fed867c6"}]}] Oct 26 11:30:16.827090 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant: tempest-TestVolumeBootPattern-2087611894 Oct 26 11:30:16.827090 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Id: e378bfab9d91492e81320139fed867c6 Oct 26 11:30:16.827090 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Name: tempest-TestVolumeBootPattern-2087611894 Oct 26 11:30:16.827090 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User: tempest-TestVolumeBootPattern-2087611894-project Oct 26 11:30:16.827090 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Id: default Oct 26 11:30:16.827090 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Name: Default Oct 26 11:30:16.827090 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Id: 1f737b4d0531425cbc803fcd15a3ea1f Oct 26 11:30:16.827090 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Name: tempest-TestVolumeBootPattern-2087611894-project Oct 26 11:30:16.827090 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: method: > Oct 26 11:30:16.827090 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: exception: Instance 1f64d1d1-56f2-4ec0-b93a-faceb3411d40 could not be found. Oct 26 11:30:16.827090 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: action_args: {'id': '1f64d1d1-56f2-4ec0-b93a-faceb3411d40'} Oct 26 11:30:16.827896 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:30:16.827896 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:30:16.827896 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:30:16.827896 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:30:16.827896 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:30:16.827896 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:30:16.827896 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:30:16.827896 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:30:16.827896 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:30:16.827896 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:30:16.827896 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f64d1d1-56f2-4ec0-b93a-faceb3411d40 could not be found. Oct 26 11:30:16.827896 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:30:16.827896 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:30:16.827896 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:30:16.827896 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:30:16.827896 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:30:16.827896 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:30:16.827896 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:30:16.827896 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:30:16.827896 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:30:16.829442 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:30:16.829442 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 11:30:16.829442 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 11:30:16.829442 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 11:30:16.829442 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 11:30:16.829442 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:30:16.829442 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:30:16.829442 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:30:16.829442 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:30:16.829442 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f64d1d1-56f2-4ec0-b93a-faceb3411d40 could not be found. Oct 26 11:30:16.829442 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:30:16.829442 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:30:16.829442 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:30:16.829442 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:30:16.829442 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:30:16.829442 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:30:16.829442 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:30:16.829442 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:30:16.829442 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f64d1d1-56f2-4ec0-b93a-faceb3411d40 could not be found. Oct 26 11:30:16.829442 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:30:16.831633 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-9644edef-7959-438e-ac1d-d9d189f04e3d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Returning 404 to user: Instance 1f64d1d1-56f2-4ec0-b93a-faceb3411d40 could not be found. {{(pid=119305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:30:16.831633 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-9644edef-7959-438e-ac1d-d9d189f04e3d tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 404 len: 111 microversion: 2.1 time: 0.030347 Oct 26 11:30:16.831633 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 526/1063] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Oct 26 11:30:16 2022] DELETE /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:30:16.836195 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-9f6c5dc3-a66e-41d9-ac8d-ae014b258d15 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:16.836826 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-9f6c5dc3-a66e-41d9-ac8d-ae014b258d15 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] [instance: 1f64d1d1-56f2-4ec0-b93a-faceb3411d40] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:16.844135 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9f6c5dc3-a66e-41d9-ac8d-ae014b258d15 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:16.844619 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9f6c5dc3-a66e-41d9-ac8d-ae014b258d15 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:16.845055 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9f6c5dc3-a66e-41d9-ac8d-ae014b258d15 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:16.845749 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9f6c5dc3-a66e-41d9-ac8d-ae014b258d15 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:16.846203 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9f6c5dc3-a66e-41d9-ac8d-ae014b258d15 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:16.846667 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9f6c5dc3-a66e-41d9-ac8d-ae014b258d15 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:16.860147 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.wsgi [None req-9f6c5dc3-a66e-41d9-ac8d-ae014b258d15 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] HTTP exception thrown: Instance 1f64d1d1-56f2-4ec0-b93a-faceb3411d40 could not be found. Oct 26 11:30:16.861723 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-9f6c5dc3-a66e-41d9-ac8d-ae014b258d15 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Request method failure captured: Oct 26 11:30:16.861723 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: request: GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 HTTP/1.1 Oct 26 11:30:16.861723 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept: application/json Oct 26 11:30:16.861723 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept-Encoding: identity Oct 26 11:30:16.861723 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Connection: close Oct 26 11:30:16.861723 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Length: 0 Oct 26 11:30:16.861723 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Type: application/json Oct 26 11:30:16.861723 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Host: 10.222.0.42 Oct 26 11:30:16.861723 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Openstack-System-Scope: None Oct 26 11:30:16.861723 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: User-Agent: python-urllib3/1.26.12 Oct 26 11:30:16.861723 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Auth-Token: gAAAAABjWRfbNpLZi4ehhxinHzLyHLguE5bpFXyCWdRz5wd7E74tg5HJJVRv8clONT6afl62Z2NRVo1fiUn-KTV4H_DhWPuGUFCfoQrS_hwunB25OMgryWhVgNo60E55f4dNNrihSGeHFIG2avl9kOUBSXoh15kKR-UWP7pL6h0FZziiSUbeMH8 Oct 26 11:30:16.861723 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Id: None Oct 26 11:30:16.861723 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Name: None Oct 26 11:30:16.861723 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Identity-Status: Confirmed Oct 26 11:30:16.861723 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Is-Admin-Project: True Oct 26 11:30:16.861723 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Id: default Oct 26 11:30:16.861723 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Name: Default Oct 26 11:30:16.861723 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Id: e378bfab9d91492e81320139fed867c6 Oct 26 11:30:16.861723 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Name: tempest-TestVolumeBootPattern-2087611894 Oct 26 11:30:16.861723 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Role: member,reader Oct 26 11:30:16.861723 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Roles: member,reader Oct 26 11:30:16.863413 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e378bfab9d91492e81320139fed867c6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e378bfab9d91492e81320139fed867c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e378bfab9d91492e81320139fed867c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e378bfab9d91492e81320139fed867c6"}]}] Oct 26 11:30:16.863413 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant: tempest-TestVolumeBootPattern-2087611894 Oct 26 11:30:16.863413 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Id: e378bfab9d91492e81320139fed867c6 Oct 26 11:30:16.863413 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Name: tempest-TestVolumeBootPattern-2087611894 Oct 26 11:30:16.863413 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User: tempest-TestVolumeBootPattern-2087611894-project Oct 26 11:30:16.863413 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Id: default Oct 26 11:30:16.863413 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Name: Default Oct 26 11:30:16.863413 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Id: 1f737b4d0531425cbc803fcd15a3ea1f Oct 26 11:30:16.863413 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Name: tempest-TestVolumeBootPattern-2087611894-project Oct 26 11:30:16.863413 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: method: > Oct 26 11:30:16.863413 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: exception: Instance 1f64d1d1-56f2-4ec0-b93a-faceb3411d40 could not be found. Oct 26 11:30:16.863413 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: action_args: {'id': '1f64d1d1-56f2-4ec0-b93a-faceb3411d40'} Oct 26 11:30:16.864249 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:30:16.864249 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:30:16.864249 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:30:16.864249 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:30:16.864249 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:30:16.864249 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:30:16.864249 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:30:16.864249 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:30:16.864249 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:30:16.864249 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:30:16.864249 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f64d1d1-56f2-4ec0-b93a-faceb3411d40 could not be found. Oct 26 11:30:16.864249 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:30:16.864249 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:30:16.864249 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:30:16.864249 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:30:16.864249 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:30:16.864249 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:30:16.864249 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:30:16.864249 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:30:16.864249 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:30:16.865477 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:30:16.865477 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 11:30:16.865477 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 11:30:16.865477 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:30:16.865477 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:30:16.865477 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:30:16.865477 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:30:16.865477 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f64d1d1-56f2-4ec0-b93a-faceb3411d40 could not be found. Oct 26 11:30:16.865477 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:30:16.865477 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:30:16.865477 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:30:16.865477 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:30:16.865477 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:30:16.865477 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:30:16.865477 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:30:16.865477 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:30:16.865477 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f64d1d1-56f2-4ec0-b93a-faceb3411d40 could not be found. Oct 26 11:30:16.865477 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:30:16.866770 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-9f6c5dc3-a66e-41d9-ac8d-ae014b258d15 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Returning 404 to user: Instance 1f64d1d1-56f2-4ec0-b93a-faceb3411d40 could not be found. {{(pid=119306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:30:16.866770 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-9f6c5dc3-a66e-41d9-ac8d-ae014b258d15 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40" status: 404 len: 111 microversion: 2.1 time: 0.030811 Oct 26 11:30:16.866770 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 538/1064] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:16 2022] GET /compute/v2.1/servers/1f64d1d1-56f2-4ec0-b93a-faceb3411d40 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 11:30:17.006196 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-9adaf3a9-d078-4a9b-89df-6893ced6e901 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:17.009149 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-9adaf3a9-d078-4a9b-89df-6893ced6e901 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:17.014281 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9adaf3a9-d078-4a9b-89df-6893ced6e901 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:17.014919 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9adaf3a9-d078-4a9b-89df-6893ced6e901 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:17.015313 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9adaf3a9-d078-4a9b-89df-6893ced6e901 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:17.016206 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9adaf3a9-d078-4a9b-89df-6893ced6e901 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:17.016675 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9adaf3a9-d078-4a9b-89df-6893ced6e901 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:17.017107 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9adaf3a9-d078-4a9b-89df-6893ced6e901 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:17.169587 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-9adaf3a9-d078-4a9b-89df-6893ced6e901 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:30:17.178400 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-9adaf3a9-d078-4a9b-89df-6893ced6e901 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1757 microversion: 2.1 time: 0.176941 Oct 26 11:30:17.182881 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 527/1065] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:17 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:30:18.204565 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-090473b8-2900-4fd6-bd6f-a0975d0e7046 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:18.205297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-090473b8-2900-4fd6-bd6f-a0975d0e7046 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:18.212844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-090473b8-2900-4fd6-bd6f-a0975d0e7046 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:18.213409 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-090473b8-2900-4fd6-bd6f-a0975d0e7046 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:18.213913 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-090473b8-2900-4fd6-bd6f-a0975d0e7046 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:18.214690 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-090473b8-2900-4fd6-bd6f-a0975d0e7046 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:18.215357 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-090473b8-2900-4fd6-bd6f-a0975d0e7046 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:18.222600 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-090473b8-2900-4fd6-bd6f-a0975d0e7046 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:18.414040 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-090473b8-2900-4fd6-bd6f-a0975d0e7046 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:30:18.422434 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-090473b8-2900-4fd6-bd6f-a0975d0e7046 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1757 microversion: 2.1 time: 0.221829 Oct 26 11:30:18.434990 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 539/1066] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:18 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1757 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:30:18.526450 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-32171e44-afe0-49d7-8072-a2e0f0ec1898 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] Calling method '.version_select at 0x7f6b938d6a60>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:18.610879 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-32171e44-afe0-49d7-8072-a2e0f0ec1898 tempest-TestVolumeBootPattern-2087611894 tempest-TestVolumeBootPattern-2087611894-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1078387089" status: 202 len: 0 microversion: 2.1 time: 0.088606 Oct 26 11:30:18.611465 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 528/1067] 10.222.0.42 () {58 vars in 1263 bytes} [Wed Oct 26 11:30:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1078387089 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 11:30:19.446442 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e9f4e7b6-a6ef-4c6e-8c15-b0e362ba6ee2 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:19.461338 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-e9f4e7b6-a6ef-4c6e-8c15-b0e362ba6ee2 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:19.461338 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e9f4e7b6-a6ef-4c6e-8c15-b0e362ba6ee2 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:19.461338 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e9f4e7b6-a6ef-4c6e-8c15-b0e362ba6ee2 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:19.461338 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e9f4e7b6-a6ef-4c6e-8c15-b0e362ba6ee2 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:19.461769 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e9f4e7b6-a6ef-4c6e-8c15-b0e362ba6ee2 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:19.461769 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e9f4e7b6-a6ef-4c6e-8c15-b0e362ba6ee2 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:19.461769 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e9f4e7b6-a6ef-4c6e-8c15-b0e362ba6ee2 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:19.605877 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-e9f4e7b6-a6ef-4c6e-8c15-b0e362ba6ee2 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:30:19.615942 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-e9f4e7b6-a6ef-4c6e-8c15-b0e362ba6ee2 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1757 microversion: 2.1 time: 0.173326 Oct 26 11:30:19.616532 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 540/1068] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:19 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:30:20.641560 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-ef840e67-afb2-4721-90d2-378887272877 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:20.643919 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-ef840e67-afb2-4721-90d2-378887272877 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:20.652155 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ef840e67-afb2-4721-90d2-378887272877 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:20.652920 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ef840e67-afb2-4721-90d2-378887272877 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:20.653417 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ef840e67-afb2-4721-90d2-378887272877 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:20.654419 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ef840e67-afb2-4721-90d2-378887272877 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:20.655390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ef840e67-afb2-4721-90d2-378887272877 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:20.656075 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-ef840e67-afb2-4721-90d2-378887272877 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:21.234606 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-ef840e67-afb2-4721-90d2-378887272877 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:30:21.243710 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-ef840e67-afb2-4721-90d2-378887272877 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1757 microversion: 2.1 time: 0.607339 Oct 26 11:30:21.246186 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 529/1069] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:20 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1757 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:30:22.269748 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-18fdebc8-b984-4b1a-972b-f5ad302c7d23 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:22.270573 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-18fdebc8-b984-4b1a-972b-f5ad302c7d23 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:22.277729 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-18fdebc8-b984-4b1a-972b-f5ad302c7d23 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:22.278403 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-18fdebc8-b984-4b1a-972b-f5ad302c7d23 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:22.278941 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-18fdebc8-b984-4b1a-972b-f5ad302c7d23 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:22.279890 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-18fdebc8-b984-4b1a-972b-f5ad302c7d23 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:22.280420 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-18fdebc8-b984-4b1a-972b-f5ad302c7d23 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:22.280916 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-18fdebc8-b984-4b1a-972b-f5ad302c7d23 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:22.454933 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-18fdebc8-b984-4b1a-972b-f5ad302c7d23 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:30:22.465459 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-18fdebc8-b984-4b1a-972b-f5ad302c7d23 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1757 microversion: 2.1 time: 0.201043 Oct 26 11:30:22.466471 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 541/1070] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:22 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1757 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:30:23.489611 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-d28c9a32-436b-45ca-85c0-248d150cf54b tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:23.490236 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-d28c9a32-436b-45ca-85c0-248d150cf54b tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:23.496852 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d28c9a32-436b-45ca-85c0-248d150cf54b tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:23.497346 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d28c9a32-436b-45ca-85c0-248d150cf54b tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:23.497790 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d28c9a32-436b-45ca-85c0-248d150cf54b tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:23.498489 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d28c9a32-436b-45ca-85c0-248d150cf54b tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:23.498978 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d28c9a32-436b-45ca-85c0-248d150cf54b tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:23.499415 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d28c9a32-436b-45ca-85c0-248d150cf54b tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:23.640902 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-d28c9a32-436b-45ca-85c0-248d150cf54b tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:30:23.649984 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-d28c9a32-436b-45ca-85c0-248d150cf54b tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1757 microversion: 2.1 time: 0.164348 Oct 26 11:30:23.650561 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 530/1071] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:23 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:30:24.673626 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-12b13556-cdcd-49cb-8b27-7ee35a752883 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:24.675939 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-12b13556-cdcd-49cb-8b27-7ee35a752883 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:24.691957 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-12b13556-cdcd-49cb-8b27-7ee35a752883 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:24.693728 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-12b13556-cdcd-49cb-8b27-7ee35a752883 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:24.694615 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-12b13556-cdcd-49cb-8b27-7ee35a752883 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:24.697063 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-12b13556-cdcd-49cb-8b27-7ee35a752883 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:24.697591 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-12b13556-cdcd-49cb-8b27-7ee35a752883 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:24.698505 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-12b13556-cdcd-49cb-8b27-7ee35a752883 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:25.248541 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-12b13556-cdcd-49cb-8b27-7ee35a752883 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:30:25.258094 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-12b13556-cdcd-49cb-8b27-7ee35a752883 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1757 microversion: 2.1 time: 0.588562 Oct 26 11:30:25.273060 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 542/1072] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:24 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1757 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:30:26.286479 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-9c399d43-7543-460e-8cb2-6345cc5a4825 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:26.287788 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-9c399d43-7543-460e-8cb2-6345cc5a4825 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:26.294669 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9c399d43-7543-460e-8cb2-6345cc5a4825 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:26.295535 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9c399d43-7543-460e-8cb2-6345cc5a4825 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:26.295667 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9c399d43-7543-460e-8cb2-6345cc5a4825 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:26.296369 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9c399d43-7543-460e-8cb2-6345cc5a4825 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:26.296824 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9c399d43-7543-460e-8cb2-6345cc5a4825 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:26.297449 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9c399d43-7543-460e-8cb2-6345cc5a4825 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:26.563934 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-9c399d43-7543-460e-8cb2-6345cc5a4825 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:30:26.572386 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-9c399d43-7543-460e-8cb2-6345cc5a4825 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1760 microversion: 2.1 time: 0.292403 Oct 26 11:30:26.572958 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 531/1073] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:26 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1760 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:30:45.296468 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-deeef1cd-0695-4abe-88ed-891e83562c01 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-480188362", "imageRef": "ed8b5733-339c-4fa7-9767-abef514cb9f2", "flavorRef": "452", "networks": [{"uuid": "a6c839a0-5fc6-4351-8012-8fd2ee054dee"}]}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:30:45.305092 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=2 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:30:45.305745 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:30:45.351370 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.network.neutron [None req-deeef1cd-0695-4abe-88ed-891e83562c01 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] validate_networks() for [('a6c839a0-5fc6-4351-8012-8fd2ee054dee', None, None, None, None, None)] {{(pid=119306) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 11:30:45.699504 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-deeef1cd-0695-4abe-88ed-891e83562c01 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Flavor limits 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 11:30:45.699948 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-deeef1cd-0695-4abe-88ed-891e83562c01 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Image limits 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 11:30:45.700399 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-deeef1cd-0695-4abe-88ed-891e83562c01 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Flavor pref 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 11:30:45.700803 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-deeef1cd-0695-4abe-88ed-891e83562c01 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Image pref 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 11:30:45.701211 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-deeef1cd-0695-4abe-88ed-891e83562c01 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 11:30:45.710760 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-deeef1cd-0695-4abe-88ed-891e83562c01 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:45.711206 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-deeef1cd-0695-4abe-88ed-891e83562c01 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:45.711641 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-deeef1cd-0695-4abe-88ed-891e83562c01 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:45.712373 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-deeef1cd-0695-4abe-88ed-891e83562c01 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:45.712823 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-deeef1cd-0695-4abe-88ed-891e83562c01 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:45.713245 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-deeef1cd-0695-4abe-88ed-891e83562c01 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:45.729666 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-deeef1cd-0695-4abe-88ed-891e83562c01 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Getting quotas for project 044799c63ce94aa39ea143e1633e2002. Resources: {'cores', 'instances', 'ram'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:30:45.733733 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-deeef1cd-0695-4abe-88ed-891e83562c01 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Getting quotas for user 18665db956ab4da28230c4c2bfe8ffa7 and project 044799c63ce94aa39ea143e1633e2002. Resources: {'cores', 'instances', 'ram'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:30:45.744772 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-deeef1cd-0695-4abe-88ed-891e83562c01 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Going to run 1 instances... {{(pid=119306) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 11:30:45.747176 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-deeef1cd-0695-4abe-88ed-891e83562c01 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed8b5733-339c-4fa7-9767-abef514cb9f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119306) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 11:30:45.896331 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-deeef1cd-0695-4abe-88ed-891e83562c01 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.603845 Oct 26 11:30:45.897147 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 543/1074] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Oct 26 11:30:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 11:30:45.908623 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-2210a128-ab2c-44f2-8584-fe75c98be248 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:45.909944 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-2210a128-ab2c-44f2-8584-fe75c98be248 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:45.911550 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:30:45.912589 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=76 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:30:45.965361 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-2210a128-ab2c-44f2-8584-fe75c98be248 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18665db956ab4da28230c4c2bfe8ffa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044799c63ce94aa39ea143e1633e2002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:30:45.972086 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-2210a128-ab2c-44f2-8584-fe75c98be248 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c" status: 200 len: 1218 microversion: 2.1 time: 0.067546 Oct 26 11:30:45.972659 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 532/1075] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:45 2022] GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:30:46.995836 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-7aa08301-1e68-49e9-9b66-c5252b32f483 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:46.996390 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-7aa08301-1e68-49e9-9b66-c5252b32f483 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:47.002275 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7aa08301-1e68-49e9-9b66-c5252b32f483 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:47.002758 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7aa08301-1e68-49e9-9b66-c5252b32f483 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:47.003227 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7aa08301-1e68-49e9-9b66-c5252b32f483 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:47.003905 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7aa08301-1e68-49e9-9b66-c5252b32f483 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:47.004354 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7aa08301-1e68-49e9-9b66-c5252b32f483 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:47.004771 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7aa08301-1e68-49e9-9b66-c5252b32f483 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:47.066246 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-7aa08301-1e68-49e9-9b66-c5252b32f483 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18665db956ab4da28230c4c2bfe8ffa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044799c63ce94aa39ea143e1633e2002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:30:47.073762 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-7aa08301-1e68-49e9-9b66-c5252b32f483 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c" status: 200 len: 1222 microversion: 2.1 time: 0.082555 Oct 26 11:30:47.077314 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 544/1076] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:46 2022] GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:30:48.097381 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a94cae55-4537-41ca-9923-892c17ea0101 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:48.097936 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-a94cae55-4537-41ca-9923-892c17ea0101 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:48.105854 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a94cae55-4537-41ca-9923-892c17ea0101 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:48.109491 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a94cae55-4537-41ca-9923-892c17ea0101 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:48.109491 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a94cae55-4537-41ca-9923-892c17ea0101 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:48.109491 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a94cae55-4537-41ca-9923-892c17ea0101 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:48.109491 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a94cae55-4537-41ca-9923-892c17ea0101 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:48.109952 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a94cae55-4537-41ca-9923-892c17ea0101 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:48.180056 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-a94cae55-4537-41ca-9923-892c17ea0101 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18665db956ab4da28230c4c2bfe8ffa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044799c63ce94aa39ea143e1633e2002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:30:48.187776 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-a94cae55-4537-41ca-9923-892c17ea0101 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c" status: 200 len: 1270 microversion: 2.1 time: 0.094332 Oct 26 11:30:48.188352 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 533/1077] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:48 2022] GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c => generated 1270 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:30:49.214750 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-006ba6f4-52b8-4b4b-bc74-126ec2f3d1e3 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:49.215548 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-006ba6f4-52b8-4b4b-bc74-126ec2f3d1e3 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:49.221831 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-006ba6f4-52b8-4b4b-bc74-126ec2f3d1e3 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:49.222318 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-006ba6f4-52b8-4b4b-bc74-126ec2f3d1e3 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:49.222756 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-006ba6f4-52b8-4b4b-bc74-126ec2f3d1e3 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:49.223470 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-006ba6f4-52b8-4b4b-bc74-126ec2f3d1e3 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:49.223921 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-006ba6f4-52b8-4b4b-bc74-126ec2f3d1e3 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:49.224852 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-006ba6f4-52b8-4b4b-bc74-126ec2f3d1e3 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:49.447139 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-006ba6f4-52b8-4b4b-bc74-126ec2f3d1e3 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18665db956ab4da28230c4c2bfe8ffa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044799c63ce94aa39ea143e1633e2002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:30:49.454789 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-006ba6f4-52b8-4b4b-bc74-126ec2f3d1e3 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c" status: 200 len: 1318 microversion: 2.1 time: 0.243943 Oct 26 11:30:49.458885 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 545/1078] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:49 2022] GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:30:50.033434 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-8b177542-22e6-472b-87c8-9b376069d959 req-2c29e496-611d-4a22-b0aa-40ab0b766a0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c", "tag": "55c7e502-11c4-4b82-ac60-6790ec30c0a6"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:30:50.043664 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-8b177542-22e6-472b-87c8-9b376069d959 req-2c29e496-611d-4a22-b0aa-40ab0b766a0c service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:50.044244 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-8b177542-22e6-472b-87c8-9b376069d959 req-2c29e496-611d-4a22-b0aa-40ab0b766a0c service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:50.044676 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-8b177542-22e6-472b-87c8-9b376069d959 req-2c29e496-611d-4a22-b0aa-40ab0b766a0c service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:50.055749 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-8b177542-22e6-472b-87c8-9b376069d959 req-2c29e496-611d-4a22-b0aa-40ab0b766a0c service nova] Creating event network-changed:55c7e502-11c4-4b82-ac60-6790ec30c0a6 for instance 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c on hv-cinder-81558 Oct 26 11:30:50.060932 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-8b177542-22e6-472b-87c8-9b376069d959 req-2c29e496-611d-4a22-b0aa-40ab0b766a0c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032645 Oct 26 11:30:50.065158 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 534/1079] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:30:50.478454 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-a2e53aff-620a-4394-b96d-7a47633cf62a tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:50.479297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-a2e53aff-620a-4394-b96d-7a47633cf62a tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:50.485774 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a2e53aff-620a-4394-b96d-7a47633cf62a tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:50.486265 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a2e53aff-620a-4394-b96d-7a47633cf62a tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:50.486702 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a2e53aff-620a-4394-b96d-7a47633cf62a tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:50.487427 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a2e53aff-620a-4394-b96d-7a47633cf62a tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:50.487886 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a2e53aff-620a-4394-b96d-7a47633cf62a tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:50.488311 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a2e53aff-620a-4394-b96d-7a47633cf62a tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:50.736551 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-a2e53aff-620a-4394-b96d-7a47633cf62a tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18665db956ab4da28230c4c2bfe8ffa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044799c63ce94aa39ea143e1633e2002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:30:50.749192 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-a2e53aff-620a-4394-b96d-7a47633cf62a tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c" status: 200 len: 1318 microversion: 2.1 time: 0.275270 Oct 26 11:30:50.750376 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 546/1080] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:50 2022] GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:30:51.773572 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-6508cf69-4600-4e69-a431-3499673fe1c5 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:51.774530 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-6508cf69-4600-4e69-a431-3499673fe1c5 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:51.780666 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6508cf69-4600-4e69-a431-3499673fe1c5 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:51.781150 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6508cf69-4600-4e69-a431-3499673fe1c5 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:51.781588 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6508cf69-4600-4e69-a431-3499673fe1c5 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:51.782274 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6508cf69-4600-4e69-a431-3499673fe1c5 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:51.782727 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6508cf69-4600-4e69-a431-3499673fe1c5 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:51.783173 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6508cf69-4600-4e69-a431-3499673fe1c5 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:51.915564 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-6508cf69-4600-4e69-a431-3499673fe1c5 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18665db956ab4da28230c4c2bfe8ffa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044799c63ce94aa39ea143e1633e2002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:30:51.923230 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-6508cf69-4600-4e69-a431-3499673fe1c5 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c" status: 200 len: 1318 microversion: 2.1 time: 0.154355 Oct 26 11:30:51.923836 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 535/1081] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:51 2022] GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:30:52.946387 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-1460f88a-dde1-4387-b558-02137bc0e607 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:52.947001 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-1460f88a-dde1-4387-b558-02137bc0e607 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:52.956191 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1460f88a-dde1-4387-b558-02137bc0e607 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:52.959248 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1460f88a-dde1-4387-b558-02137bc0e607 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:52.959248 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1460f88a-dde1-4387-b558-02137bc0e607 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:52.959248 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1460f88a-dde1-4387-b558-02137bc0e607 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:52.959248 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1460f88a-dde1-4387-b558-02137bc0e607 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:52.959639 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1460f88a-dde1-4387-b558-02137bc0e607 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:53.090926 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-1460f88a-dde1-4387-b558-02137bc0e607 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18665db956ab4da28230c4c2bfe8ffa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044799c63ce94aa39ea143e1633e2002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:30:53.098574 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-1460f88a-dde1-4387-b558-02137bc0e607 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c" status: 200 len: 1318 microversion: 2.1 time: 0.156224 Oct 26 11:30:53.099652 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 547/1082] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:52 2022] GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:30:54.123913 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-0c5c7464-c50b-4987-b028-1fbbb734130c tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:54.124793 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-0c5c7464-c50b-4987-b028-1fbbb734130c tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:54.134372 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0c5c7464-c50b-4987-b028-1fbbb734130c tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:54.135098 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0c5c7464-c50b-4987-b028-1fbbb734130c tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:54.135706 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0c5c7464-c50b-4987-b028-1fbbb734130c tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:54.136735 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0c5c7464-c50b-4987-b028-1fbbb734130c tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:54.137388 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0c5c7464-c50b-4987-b028-1fbbb734130c tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:54.137993 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0c5c7464-c50b-4987-b028-1fbbb734130c tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:54.291561 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-0c5c7464-c50b-4987-b028-1fbbb734130c tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18665db956ab4da28230c4c2bfe8ffa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044799c63ce94aa39ea143e1633e2002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:30:54.299976 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-0c5c7464-c50b-4987-b028-1fbbb734130c tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c" status: 200 len: 1318 microversion: 2.1 time: 0.181536 Oct 26 11:30:54.300563 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 536/1083] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:54 2022] GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:30:55.325419 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-d6937834-4d69-4d67-9c5f-d83955a17e65 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:55.326034 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-d6937834-4d69-4d67-9c5f-d83955a17e65 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:55.332684 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d6937834-4d69-4d67-9c5f-d83955a17e65 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:55.333168 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d6937834-4d69-4d67-9c5f-d83955a17e65 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:55.333613 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d6937834-4d69-4d67-9c5f-d83955a17e65 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:55.334886 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d6937834-4d69-4d67-9c5f-d83955a17e65 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:55.335345 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d6937834-4d69-4d67-9c5f-d83955a17e65 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:55.335760 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d6937834-4d69-4d67-9c5f-d83955a17e65 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:55.464353 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-d6937834-4d69-4d67-9c5f-d83955a17e65 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18665db956ab4da28230c4c2bfe8ffa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044799c63ce94aa39ea143e1633e2002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:30:55.471868 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-d6937834-4d69-4d67-9c5f-d83955a17e65 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c" status: 200 len: 1318 microversion: 2.1 time: 0.150552 Oct 26 11:30:55.472484 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 548/1084] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:55 2022] GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:30:56.430238 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-51b8fddb-381e-40e8-81c6-fe9192dc6a35 req-316cdb1e-63e9-47d0-a464-2cf877a894eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c", "name": "network-vif-plugged", "status": "completed", "tag": "55c7e502-11c4-4b82-ac60-6790ec30c0a6"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:30:56.435950 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell0:SELECT=2 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:30:56.441319 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-51b8fddb-381e-40e8-81c6-fe9192dc6a35 req-316cdb1e-63e9-47d0-a464-2cf877a894eb service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:56.441798 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-51b8fddb-381e-40e8-81c6-fe9192dc6a35 req-316cdb1e-63e9-47d0-a464-2cf877a894eb service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:56.442228 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-51b8fddb-381e-40e8-81c6-fe9192dc6a35 req-316cdb1e-63e9-47d0-a464-2cf877a894eb service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:56.454373 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-51b8fddb-381e-40e8-81c6-fe9192dc6a35 req-316cdb1e-63e9-47d0-a464-2cf877a894eb service nova] Creating event network-vif-plugged:55c7e502-11c4-4b82-ac60-6790ec30c0a6 for instance 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c on hv-cinder-81558 Oct 26 11:30:56.459513 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-51b8fddb-381e-40e8-81c6-fe9192dc6a35 req-316cdb1e-63e9-47d0-a464-2cf877a894eb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033584 Oct 26 11:30:56.460167 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 537/1085] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:30:56.494565 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e85d9453-1324-4f94-87a4-aaa2717e0c71 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:56.499588 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-e85d9453-1324-4f94-87a4-aaa2717e0c71 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:56.499588 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell0:SELECT=2 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:30:56.499588 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell0:SELECT=6 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:30:56.503041 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e85d9453-1324-4f94-87a4-aaa2717e0c71 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:56.503531 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e85d9453-1324-4f94-87a4-aaa2717e0c71 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:56.503969 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e85d9453-1324-4f94-87a4-aaa2717e0c71 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:56.504667 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e85d9453-1324-4f94-87a4-aaa2717e0c71 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:56.505119 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e85d9453-1324-4f94-87a4-aaa2717e0c71 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:56.506131 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e85d9453-1324-4f94-87a4-aaa2717e0c71 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:56.643137 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-e85d9453-1324-4f94-87a4-aaa2717e0c71 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18665db956ab4da28230c4c2bfe8ffa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044799c63ce94aa39ea143e1633e2002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:30:56.651780 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-e85d9453-1324-4f94-87a4-aaa2717e0c71 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c" status: 200 len: 1318 microversion: 2.1 time: 0.161559 Oct 26 11:30:56.652359 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 549/1086] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:56 2022] GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:30:57.677029 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-59f6181e-8212-4c06-a901-f975909ee661 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:57.677664 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-59f6181e-8212-4c06-a901-f975909ee661 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:57.683916 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-59f6181e-8212-4c06-a901-f975909ee661 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:57.684396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-59f6181e-8212-4c06-a901-f975909ee661 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:57.684831 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-59f6181e-8212-4c06-a901-f975909ee661 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:57.685511 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-59f6181e-8212-4c06-a901-f975909ee661 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:57.685959 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-59f6181e-8212-4c06-a901-f975909ee661 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:57.686377 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-59f6181e-8212-4c06-a901-f975909ee661 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:57.818476 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-59f6181e-8212-4c06-a901-f975909ee661 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18665db956ab4da28230c4c2bfe8ffa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044799c63ce94aa39ea143e1633e2002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:30:57.826312 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-59f6181e-8212-4c06-a901-f975909ee661 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c" status: 200 len: 1318 microversion: 2.1 time: 0.154583 Oct 26 11:30:57.826906 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 538/1087] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:57 2022] GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:30:58.849789 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-5097b402-1c2d-41b1-bf4c-3e9ef47348f8 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:30:58.850405 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-5097b402-1c2d-41b1-bf4c-3e9ef47348f8 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:30:58.857373 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5097b402-1c2d-41b1-bf4c-3e9ef47348f8 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:58.857858 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5097b402-1c2d-41b1-bf4c-3e9ef47348f8 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:58.858291 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5097b402-1c2d-41b1-bf4c-3e9ef47348f8 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:58.859017 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5097b402-1c2d-41b1-bf4c-3e9ef47348f8 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:30:58.859471 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5097b402-1c2d-41b1-bf4c-3e9ef47348f8 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:30:58.859891 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5097b402-1c2d-41b1-bf4c-3e9ef47348f8 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:30:58.992899 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-5097b402-1c2d-41b1-bf4c-3e9ef47348f8 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18665db956ab4da28230c4c2bfe8ffa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044799c63ce94aa39ea143e1633e2002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:30:59.000593 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-5097b402-1c2d-41b1-bf4c-3e9ef47348f8 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c" status: 200 len: 1506 microversion: 2.1 time: 0.154716 Oct 26 11:30:59.001162 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 550/1088] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:30:58 2022] GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:14.721606 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-7edf3a14-bef0-4704-90bb-0e29006f2eaa tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:14.722127 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-7edf3a14-bef0-4704-90bb-0e29006f2eaa tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:14.724633 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_api:SELECT=16 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:31:14.725477 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=28 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:31:14.730001 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7edf3a14-bef0-4704-90bb-0e29006f2eaa tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:14.730480 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7edf3a14-bef0-4704-90bb-0e29006f2eaa tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:14.730946 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7edf3a14-bef0-4704-90bb-0e29006f2eaa tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:14.731638 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7edf3a14-bef0-4704-90bb-0e29006f2eaa tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:14.732088 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7edf3a14-bef0-4704-90bb-0e29006f2eaa tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:14.732506 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7edf3a14-bef0-4704-90bb-0e29006f2eaa tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:14.756036 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-7edf3a14-bef0-4704-90bb-0e29006f2eaa tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3/ips" status: 200 len: 146 microversion: 2.1 time: 0.038173 Oct 26 11:31:14.756544 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 539/1089] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Oct 26 11:31:14 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:31:19.101453 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-9e4fdada-d7a5-4fb7-b5ce-0be46e18d077 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccd07e3c-bf3a-4b62-9162-b98476a69151"}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:31:19.104010 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-9e4fdada-d7a5-4fb7-b5ce-0be46e18d077 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:19.106805 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:31:19.107571 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=44 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:31:19.112308 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9e4fdada-d7a5-4fb7-b5ce-0be46e18d077 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:19.112800 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9e4fdada-d7a5-4fb7-b5ce-0be46e18d077 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:19.113318 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9e4fdada-d7a5-4fb7-b5ce-0be46e18d077 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:19.114051 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9e4fdada-d7a5-4fb7-b5ce-0be46e18d077 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:19.114514 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9e4fdada-d7a5-4fb7-b5ce-0be46e18d077 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:19.114976 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9e4fdada-d7a5-4fb7-b5ce-0be46e18d077 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:19.925065 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-9e4fdada-d7a5-4fb7-b5ce-0be46e18d077 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "POST /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.827697 Oct 26 11:31:19.925685 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 551/1090] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Oct 26 11:31:19 2022] POST /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3/os-volume_attachments => generated 194 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:31:22.974169 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-894510bc-f7f9-4a76-82d5-925ac60e2dcb tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c049a1de-9a4b-4d0b-9b5f-dca9dca5c2ad", "device": "/dev/sdb"}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:31:22.977074 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-894510bc-f7f9-4a76-82d5-925ac60e2dcb tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:22.984942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-894510bc-f7f9-4a76-82d5-925ac60e2dcb tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:22.985428 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-894510bc-f7f9-4a76-82d5-925ac60e2dcb tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:22.985870 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-894510bc-f7f9-4a76-82d5-925ac60e2dcb tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:22.986565 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-894510bc-f7f9-4a76-82d5-925ac60e2dcb tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:22.987130 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-894510bc-f7f9-4a76-82d5-925ac60e2dcb tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:22.987561 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-894510bc-f7f9-4a76-82d5-925ac60e2dcb tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:23.757201 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-894510bc-f7f9-4a76-82d5-925ac60e2dcb tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "POST /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.786940 Oct 26 11:31:23.757915 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 540/1091] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Oct 26 11:31:22 2022] POST /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c/os-volume_attachments => generated 194 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:31:28.516376 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-f19142b7-3881-4253-8c1a-6872a29a9cf3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:31:28.522575 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f19142b7-3881-4253-8c1a-6872a29a9cf3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:28.523118 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f19142b7-3881-4253-8c1a-6872a29a9cf3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:28.523544 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f19142b7-3881-4253-8c1a-6872a29a9cf3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:28.584565 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-f19142b7-3881-4253-8c1a-6872a29a9cf3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Going to try to stop instance {{(pid=119306) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 26 11:31:28.756418 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-f19142b7-3881-4253-8c1a-6872a29a9cf3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "POST /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3/action" status: 202 len: 0 microversion: 2.1 time: 0.245692 Oct 26 11:31:28.757073 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 552/1092] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Oct 26 11:31:28 2022] POST /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 11:31:28.767078 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-cc447194-3ad2-4b01-9ecd-719e68664f9c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:28.767791 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-cc447194-3ad2-4b01-9ecd-719e68664f9c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:28.773930 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cc447194-3ad2-4b01-9ecd-719e68664f9c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:28.774472 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cc447194-3ad2-4b01-9ecd-719e68664f9c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:28.775194 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cc447194-3ad2-4b01-9ecd-719e68664f9c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:28.775891 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cc447194-3ad2-4b01-9ecd-719e68664f9c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:28.776348 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cc447194-3ad2-4b01-9ecd-719e68664f9c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:28.776777 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-cc447194-3ad2-4b01-9ecd-719e68664f9c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:28.905653 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-cc447194-3ad2-4b01-9ecd-719e68664f9c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:28.913767 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-cc447194-3ad2-4b01-9ecd-719e68664f9c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1724 microversion: 2.1 time: 0.152086 Oct 26 11:31:28.914327 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 541/1093] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:28 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:29.938948 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e2b01569-26ad-4ec9-8d47-3b61cf549762 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:29.939649 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-e2b01569-26ad-4ec9-8d47-3b61cf549762 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:29.945694 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2b01569-26ad-4ec9-8d47-3b61cf549762 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:29.946178 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2b01569-26ad-4ec9-8d47-3b61cf549762 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:29.946612 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2b01569-26ad-4ec9-8d47-3b61cf549762 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:29.947327 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2b01569-26ad-4ec9-8d47-3b61cf549762 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:29.947783 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2b01569-26ad-4ec9-8d47-3b61cf549762 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:29.948205 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e2b01569-26ad-4ec9-8d47-3b61cf549762 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:30.073614 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-e2b01569-26ad-4ec9-8d47-3b61cf549762 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:30.081736 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-e2b01569-26ad-4ec9-8d47-3b61cf549762 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1724 microversion: 2.1 time: 0.148299 Oct 26 11:31:30.082313 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 553/1094] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:29 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:30.691019 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-c697a061-cdc7-401b-9aa2-a84a4e6479d4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-342134755"}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:31:30.691615 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-c697a061-cdc7-401b-9aa2-a84a4e6479d4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:30.697823 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c697a061-cdc7-401b-9aa2-a84a4e6479d4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:30.698295 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c697a061-cdc7-401b-9aa2-a84a4e6479d4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:30.698726 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c697a061-cdc7-401b-9aa2-a84a4e6479d4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:30.699428 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c697a061-cdc7-401b-9aa2-a84a4e6479d4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:30.699873 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c697a061-cdc7-401b-9aa2-a84a4e6479d4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:30.700291 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c697a061-cdc7-401b-9aa2-a84a4e6479d4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:30.824023 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.network.security_group_api [None req-c697a061-cdc7-401b-9aa2-a84a4e6479d4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Removing security group ba73caf4-4697-4c56-9274-a12d28569beb from port 436d699c-83eb-4925-85b5-851f53994190 Oct 26 11:31:31.108949 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-7ec49453-24a2-4ab4-8884-94773c902218 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:31.112482 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-7ec49453-24a2-4ab4-8884-94773c902218 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:31.115890 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7ec49453-24a2-4ab4-8884-94773c902218 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:31.116368 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7ec49453-24a2-4ab4-8884-94773c902218 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:31.116798 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7ec49453-24a2-4ab4-8884-94773c902218 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:31.117478 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7ec49453-24a2-4ab4-8884-94773c902218 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:31.117924 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7ec49453-24a2-4ab4-8884-94773c902218 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:31.118338 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7ec49453-24a2-4ab4-8884-94773c902218 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:31.174680 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-c697a061-cdc7-401b-9aa2-a84a4e6479d4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "POST /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5/action" status: 202 len: 0 microversion: 2.1 time: 0.487636 Oct 26 11:31:31.175834 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 542/1095] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Oct 26 11:31:30 2022] POST /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 11:31:31.189371 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-ea70b8ee-61b8-487a-9ba7-120dbde287e5 req-be9c9c33-8dde-44c3-bdd1-3396bfeaff87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbf3d5fd-8067-49a1-b4e3-51f5949018d5", "tag": "436d699c-83eb-4925-85b5-851f53994190"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:31:31.204759 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-ea70b8ee-61b8-487a-9ba7-120dbde287e5 req-be9c9c33-8dde-44c3-bdd1-3396bfeaff87 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:31.205460 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-ea70b8ee-61b8-487a-9ba7-120dbde287e5 req-be9c9c33-8dde-44c3-bdd1-3396bfeaff87 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:31.206216 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-ea70b8ee-61b8-487a-9ba7-120dbde287e5 req-be9c9c33-8dde-44c3-bdd1-3396bfeaff87 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:31.221205 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-ea70b8ee-61b8-487a-9ba7-120dbde287e5 req-be9c9c33-8dde-44c3-bdd1-3396bfeaff87 service nova] Creating event network-changed:436d699c-83eb-4925-85b5-851f53994190 for instance cbf3d5fd-8067-49a1-b4e3-51f5949018d5 on hv-cinder-81558 Oct 26 11:31:31.228110 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-ea70b8ee-61b8-487a-9ba7-120dbde287e5 req-be9c9c33-8dde-44c3-bdd1-3396bfeaff87 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043012 Oct 26 11:31:31.229479 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 543/1096] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:31:31.269608 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-7ec49453-24a2-4ab4-8884-94773c902218 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:31.283880 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-7ec49453-24a2-4ab4-8884-94773c902218 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1724 microversion: 2.1 time: 0.178791 Oct 26 11:31:31.285148 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 554/1097] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:31 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:31:32.313418 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-6e26dddd-0803-4504-8201-9b36966fbe0c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:32.314316 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-6e26dddd-0803-4504-8201-9b36966fbe0c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:32.320914 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6e26dddd-0803-4504-8201-9b36966fbe0c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:32.321608 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6e26dddd-0803-4504-8201-9b36966fbe0c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:32.322251 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6e26dddd-0803-4504-8201-9b36966fbe0c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:32.323146 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6e26dddd-0803-4504-8201-9b36966fbe0c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:32.323754 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6e26dddd-0803-4504-8201-9b36966fbe0c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:32.324329 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6e26dddd-0803-4504-8201-9b36966fbe0c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:32.458304 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-6e26dddd-0803-4504-8201-9b36966fbe0c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:32.463347 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-6e26dddd-0803-4504-8201-9b36966fbe0c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1724 microversion: 2.1 time: 0.154759 Oct 26 11:31:32.463911 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 544/1098] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:32 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:32.882690 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-5ca56be0-a847-45c5-b9f8-37784cadf295 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:32.883324 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-5ca56be0-a847-45c5-b9f8-37784cadf295 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:32.883474 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-802a145a-0d28-443b-aeaa-63dde5347c41 req-7b0283b4-3405-4f0a-ba1f-959fe2dd751e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbf3d5fd-8067-49a1-b4e3-51f5949018d5", "tag": "436d699c-83eb-4925-85b5-851f53994190"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:31:32.890222 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5ca56be0-a847-45c5-b9f8-37784cadf295 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:32.891486 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5ca56be0-a847-45c5-b9f8-37784cadf295 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:32.893671 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5ca56be0-a847-45c5-b9f8-37784cadf295 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:32.894587 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-802a145a-0d28-443b-aeaa-63dde5347c41 req-7b0283b4-3405-4f0a-ba1f-959fe2dd751e service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:32.895284 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-802a145a-0d28-443b-aeaa-63dde5347c41 req-7b0283b4-3405-4f0a-ba1f-959fe2dd751e service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:32.895714 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-802a145a-0d28-443b-aeaa-63dde5347c41 req-7b0283b4-3405-4f0a-ba1f-959fe2dd751e service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:32.896513 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5ca56be0-a847-45c5-b9f8-37784cadf295 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:32.897175 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5ca56be0-a847-45c5-b9f8-37784cadf295 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:32.898374 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5ca56be0-a847-45c5-b9f8-37784cadf295 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:32.909499 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-802a145a-0d28-443b-aeaa-63dde5347c41 req-7b0283b4-3405-4f0a-ba1f-959fe2dd751e service nova] Creating event network-changed:436d699c-83eb-4925-85b5-851f53994190 for instance cbf3d5fd-8067-49a1-b4e3-51f5949018d5 on hv-cinder-81558 Oct 26 11:31:32.915239 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-802a145a-0d28-443b-aeaa-63dde5347c41 req-7b0283b4-3405-4f0a-ba1f-959fe2dd751e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035236 Oct 26 11:31:32.918695 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 555/1099] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:31:33.014924 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.objects.instance [None req-5ca56be0-a847-45c5-b9f8-37784cadf295 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lazy-loading 'services' on Instance uuid cbf3d5fd-8067-49a1-b4e3-51f5949018d5 {{(pid=119305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:31:33.267643 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-5ca56be0-a847-45c5-b9f8-37784cadf295 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5/os-volume_attachments/b60e159b-f7a7-4e53-800b-86084e888b6b" status: 202 len: 0 microversion: 2.1 time: 0.388518 Oct 26 11:31:33.268499 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 545/1100] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Oct 26 11:31:32 2022] DELETE /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5/os-volume_attachments/b60e159b-f7a7-4e53-800b-86084e888b6b => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 11:31:33.279599 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-c8d3b234-3045-4163-b3de-92acdca977c4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:33.284214 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-c8d3b234-3045-4163-b3de-92acdca977c4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:33.292217 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c8d3b234-3045-4163-b3de-92acdca977c4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:33.293116 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c8d3b234-3045-4163-b3de-92acdca977c4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:33.293540 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c8d3b234-3045-4163-b3de-92acdca977c4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:33.294493 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c8d3b234-3045-4163-b3de-92acdca977c4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:33.294991 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c8d3b234-3045-4163-b3de-92acdca977c4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:33.296016 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c8d3b234-3045-4163-b3de-92acdca977c4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:33.328313 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-c8d3b234-3045-4163-b3de-92acdca977c4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055385 Oct 26 11:31:33.328881 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 556/1101] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Oct 26 11:31:33 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:31:33.487133 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-180d245a-a72e-4540-9924-b054291e9ce2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:33.487839 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-180d245a-a72e-4540-9924-b054291e9ce2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:33.494041 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-180d245a-a72e-4540-9924-b054291e9ce2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:33.494525 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-180d245a-a72e-4540-9924-b054291e9ce2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:33.494985 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-180d245a-a72e-4540-9924-b054291e9ce2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:33.495935 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-180d245a-a72e-4540-9924-b054291e9ce2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:33.496482 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-180d245a-a72e-4540-9924-b054291e9ce2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:33.497132 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-180d245a-a72e-4540-9924-b054291e9ce2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:33.632768 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-180d245a-a72e-4540-9924-b054291e9ce2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:33.641865 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-180d245a-a72e-4540-9924-b054291e9ce2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1724 microversion: 2.1 time: 0.159641 Oct 26 11:31:33.642472 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 546/1102] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:33 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:34.341011 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-8cef8f20-d7c0-4e25-bb8c-52be36ac95f1 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:34.343274 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-8cef8f20-d7c0-4e25-bb8c-52be36ac95f1 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:34.349639 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8cef8f20-d7c0-4e25-bb8c-52be36ac95f1 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:34.350126 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8cef8f20-d7c0-4e25-bb8c-52be36ac95f1 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:34.350554 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8cef8f20-d7c0-4e25-bb8c-52be36ac95f1 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:34.351265 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8cef8f20-d7c0-4e25-bb8c-52be36ac95f1 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:34.351716 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8cef8f20-d7c0-4e25-bb8c-52be36ac95f1 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:34.352138 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8cef8f20-d7c0-4e25-bb8c-52be36ac95f1 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:34.383396 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-8cef8f20-d7c0-4e25-bb8c-52be36ac95f1 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046344 Oct 26 11:31:34.383936 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 557/1103] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Oct 26 11:31:34 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:31:34.665619 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-7e761b50-6760-45e8-a241-a7b1c00f4eb3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:34.666359 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-7e761b50-6760-45e8-a241-a7b1c00f4eb3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:34.673301 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7e761b50-6760-45e8-a241-a7b1c00f4eb3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:34.673791 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7e761b50-6760-45e8-a241-a7b1c00f4eb3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:34.674235 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7e761b50-6760-45e8-a241-a7b1c00f4eb3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:34.675023 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7e761b50-6760-45e8-a241-a7b1c00f4eb3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:34.675468 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7e761b50-6760-45e8-a241-a7b1c00f4eb3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:34.675920 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7e761b50-6760-45e8-a241-a7b1c00f4eb3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:34.805073 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-7e761b50-6760-45e8-a241-a7b1c00f4eb3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:34.813740 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-7e761b50-6760-45e8-a241-a7b1c00f4eb3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1724 microversion: 2.1 time: 0.152040 Oct 26 11:31:34.814246 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 547/1104] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:34 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:35.395845 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-971ff02c-052b-42a3-8105-6bfd639860a4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:35.398186 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-971ff02c-052b-42a3-8105-6bfd639860a4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:35.406763 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-971ff02c-052b-42a3-8105-6bfd639860a4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:35.407273 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-971ff02c-052b-42a3-8105-6bfd639860a4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:35.407841 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-971ff02c-052b-42a3-8105-6bfd639860a4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:35.408554 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-971ff02c-052b-42a3-8105-6bfd639860a4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:35.409007 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-971ff02c-052b-42a3-8105-6bfd639860a4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:35.409429 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-971ff02c-052b-42a3-8105-6bfd639860a4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:35.438908 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-971ff02c-052b-42a3-8105-6bfd639860a4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047004 Oct 26 11:31:35.439460 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 558/1105] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Oct 26 11:31:35 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:31:35.837269 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a51055a8-d243-4826-b1d2-04d9594c0b52 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:35.837880 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-a51055a8-d243-4826-b1d2-04d9594c0b52 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:35.844320 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a51055a8-d243-4826-b1d2-04d9594c0b52 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:35.844803 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a51055a8-d243-4826-b1d2-04d9594c0b52 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:35.845319 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a51055a8-d243-4826-b1d2-04d9594c0b52 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:35.846017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a51055a8-d243-4826-b1d2-04d9594c0b52 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:35.846511 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a51055a8-d243-4826-b1d2-04d9594c0b52 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:35.846954 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a51055a8-d243-4826-b1d2-04d9594c0b52 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:35.978767 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-a51055a8-d243-4826-b1d2-04d9594c0b52 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:35.988262 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-a51055a8-d243-4826-b1d2-04d9594c0b52 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1724 microversion: 2.1 time: 0.154789 Oct 26 11:31:35.995762 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 548/1106] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:35 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:36.451323 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-bb1b6b6c-d0e2-47fd-81fd-0a27877d6a8c tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:36.454054 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-bb1b6b6c-d0e2-47fd-81fd-0a27877d6a8c tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:36.460302 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bb1b6b6c-d0e2-47fd-81fd-0a27877d6a8c tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:36.460775 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bb1b6b6c-d0e2-47fd-81fd-0a27877d6a8c tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:36.461204 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bb1b6b6c-d0e2-47fd-81fd-0a27877d6a8c tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:36.461878 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bb1b6b6c-d0e2-47fd-81fd-0a27877d6a8c tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:36.462324 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bb1b6b6c-d0e2-47fd-81fd-0a27877d6a8c tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:36.462739 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-bb1b6b6c-d0e2-47fd-81fd-0a27877d6a8c tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:36.489961 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-bb1b6b6c-d0e2-47fd-81fd-0a27877d6a8c tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042584 Oct 26 11:31:36.490505 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 559/1107] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Oct 26 11:31:36 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 11:31:36.502517 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-2c4305a1-8735-4a3a-aff7-a15d7587b90d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:36.503053 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-2c4305a1-8735-4a3a-aff7-a15d7587b90d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:36.508929 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2c4305a1-8735-4a3a-aff7-a15d7587b90d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:36.509415 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2c4305a1-8735-4a3a-aff7-a15d7587b90d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:36.509855 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2c4305a1-8735-4a3a-aff7-a15d7587b90d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:36.510550 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2c4305a1-8735-4a3a-aff7-a15d7587b90d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:36.511041 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2c4305a1-8735-4a3a-aff7-a15d7587b90d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:36.511473 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2c4305a1-8735-4a3a-aff7-a15d7587b90d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:36.585090 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.wsgi [None req-2c4305a1-8735-4a3a-aff7-a15d7587b90d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] HTTP exception thrown: Instance cbf3d5fd-8067-49a1-b4e3-51f5949018d5 is not attached to volume b60e159b-f7a7-4e53-800b-86084e888b6b Oct 26 11:31:36.587399 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-2c4305a1-8735-4a3a-aff7-a15d7587b90d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Request method failure captured: Oct 26 11:31:36.587399 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: request: DELETE /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5/os-volume_attachments/b60e159b-f7a7-4e53-800b-86084e888b6b HTTP/1.1 Oct 26 11:31:36.587399 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept: application/json Oct 26 11:31:36.587399 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept-Encoding: identity Oct 26 11:31:36.587399 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Connection: close Oct 26 11:31:36.587399 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Length: 0 Oct 26 11:31:36.587399 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Type: application/json Oct 26 11:31:36.587399 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Host: 10.222.0.42 Oct 26 11:31:36.587399 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Openstack-System-Scope: None Oct 26 11:31:36.587399 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: User-Agent: python-urllib3/1.26.12 Oct 26 11:31:36.587399 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Auth-Token: gAAAAABjWRmsHCasD_Ad81_f27sT9kh0u7hq0prBbqPA99gQiu9QD0uFLglMfEHiLDw8VN4NdfGUwBvKV4yEpZCW_sue8DQawMLWlCyym89Diuhe2F8c4CI-K3BsDxaLA00DpnG9HFALZ8vouZUFuKjyCAKInBqZBMbTT7YUGTyjaqyi4qlDv88 Oct 26 11:31:36.587399 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Id: None Oct 26 11:31:36.587399 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Name: None Oct 26 11:31:36.587399 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Identity-Status: Confirmed Oct 26 11:31:36.587399 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Is-Admin-Project: True Oct 26 11:31:36.587399 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Id: default Oct 26 11:31:36.587399 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Name: Default Oct 26 11:31:36.587399 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Id: a975701f3c69481b874e106eb5d4edcd Oct 26 11:31:36.587399 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Name: tempest-TestMinimumBasicScenario-1084096257 Oct 26 11:31:36.587399 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Role: member,reader Oct 26 11:31:36.587399 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Roles: member,reader Oct 26 11:31:36.589104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a975701f3c69481b874e106eb5d4edcd", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a975701f3c69481b874e106eb5d4edcd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a975701f3c69481b874e106eb5d4edcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a975701f3c69481b874e106eb5d4edcd"}]}] Oct 26 11:31:36.589104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant: tempest-TestMinimumBasicScenario-1084096257 Oct 26 11:31:36.589104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Id: a975701f3c69481b874e106eb5d4edcd Oct 26 11:31:36.589104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1084096257 Oct 26 11:31:36.589104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User: tempest-TestMinimumBasicScenario-1084096257-project Oct 26 11:31:36.589104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Id: default Oct 26 11:31:36.589104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Name: Default Oct 26 11:31:36.589104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Id: e7088cf9374c4e7d8e60c34a782fb42f Oct 26 11:31:36.589104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Name: tempest-TestMinimumBasicScenario-1084096257-project Oct 26 11:31:36.589104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: method: > Oct 26 11:31:36.589104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: exception: Instance cbf3d5fd-8067-49a1-b4e3-51f5949018d5 is not attached to volume b60e159b-f7a7-4e53-800b-86084e888b6b Oct 26 11:31:36.590152 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: action_args: {'server_id': 'cbf3d5fd-8067-49a1-b4e3-51f5949018d5', 'id': 'b60e159b-f7a7-4e53-800b-86084e888b6b'} Oct 26 11:31:36.590152 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:31:36.590152 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:31:36.590152 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 26 11:31:36.590152 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 26 11:31:36.590152 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 26 11:31:36.590152 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 26 11:31:36.590152 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 26 11:31:36.590152 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 26 11:31:36.590152 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b60e159b-f7a7-4e53-800b-86084e888b6b. Oct 26 11:31:36.590152 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:31:36.590152 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:31:36.590152 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:31:36.590152 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:31:36.590152 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:31:36.590152 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:31:36.590152 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:31:36.590152 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:31:36.590152 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:31:36.591723 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:31:36.591723 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 26 11:31:36.591723 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 26 11:31:36.591723 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbf3d5fd-8067-49a1-b4e3-51f5949018d5 is not attached to volume b60e159b-f7a7-4e53-800b-86084e888b6b Oct 26 11:31:36.591723 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:31:36.591723 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:31:36.591723 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:31:36.591723 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:31:36.591723 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:31:36.591723 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:31:36.591723 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:31:36.591723 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:31:36.591723 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbf3d5fd-8067-49a1-b4e3-51f5949018d5 is not attached to volume b60e159b-f7a7-4e53-800b-86084e888b6b Oct 26 11:31:36.591723 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:31:36.591723 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-2c4305a1-8735-4a3a-aff7-a15d7587b90d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Returning 404 to user: Instance cbf3d5fd-8067-49a1-b4e3-51f5949018d5 is not attached to volume b60e159b-f7a7-4e53-800b-86084e888b6b {{(pid=119305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:31:36.593039 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-2c4305a1-8735-4a3a-aff7-a15d7587b90d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5/os-volume_attachments/b60e159b-f7a7-4e53-800b-86084e888b6b" status: 404 len: 154 microversion: 2.1 time: 0.090771 Oct 26 11:31:36.593039 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 549/1108] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Oct 26 11:31:36 2022] DELETE /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5/os-volume_attachments/b60e159b-f7a7-4e53-800b-86084e888b6b => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:31:37.012246 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-35934207-5aeb-490f-b6ec-6eca6d5350d2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:37.012780 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-35934207-5aeb-490f-b6ec-6eca6d5350d2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:37.018661 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-35934207-5aeb-490f-b6ec-6eca6d5350d2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:37.019175 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-35934207-5aeb-490f-b6ec-6eca6d5350d2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:37.019607 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-35934207-5aeb-490f-b6ec-6eca6d5350d2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:37.020292 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-35934207-5aeb-490f-b6ec-6eca6d5350d2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:37.020737 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-35934207-5aeb-490f-b6ec-6eca6d5350d2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:37.021154 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-35934207-5aeb-490f-b6ec-6eca6d5350d2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:37.150295 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-35934207-5aeb-490f-b6ec-6eca6d5350d2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:37.158925 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-35934207-5aeb-490f-b6ec-6eca6d5350d2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1724 microversion: 2.1 time: 0.150574 Oct 26 11:31:37.159493 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 560/1109] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:37 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:38.182109 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-30e5b3bd-eac1-44f1-aad2-a1f2f1027850 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:38.182730 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-30e5b3bd-eac1-44f1-aad2-a1f2f1027850 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:38.190651 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-30e5b3bd-eac1-44f1-aad2-a1f2f1027850 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:38.191167 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-30e5b3bd-eac1-44f1-aad2-a1f2f1027850 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:38.191606 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-30e5b3bd-eac1-44f1-aad2-a1f2f1027850 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:38.192310 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-30e5b3bd-eac1-44f1-aad2-a1f2f1027850 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:38.192764 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-30e5b3bd-eac1-44f1-aad2-a1f2f1027850 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:38.193237 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-30e5b3bd-eac1-44f1-aad2-a1f2f1027850 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:38.317362 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-30e5b3bd-eac1-44f1-aad2-a1f2f1027850 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:38.325527 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-30e5b3bd-eac1-44f1-aad2-a1f2f1027850 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1724 microversion: 2.1 time: 0.147255 Oct 26 11:31:38.326087 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 550/1110] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:38 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:39.348765 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-776dee55-3a07-4b50-a91f-ed88ba7210db tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:39.349304 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-776dee55-3a07-4b50-a91f-ed88ba7210db tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:39.355739 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-776dee55-3a07-4b50-a91f-ed88ba7210db tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:39.356260 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-776dee55-3a07-4b50-a91f-ed88ba7210db tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:39.356697 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-776dee55-3a07-4b50-a91f-ed88ba7210db tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:39.357388 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-776dee55-3a07-4b50-a91f-ed88ba7210db tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:39.357844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-776dee55-3a07-4b50-a91f-ed88ba7210db tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:39.358270 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-776dee55-3a07-4b50-a91f-ed88ba7210db tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:39.487364 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-776dee55-3a07-4b50-a91f-ed88ba7210db tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:39.495713 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-776dee55-3a07-4b50-a91f-ed88ba7210db tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1724 microversion: 2.1 time: 0.150837 Oct 26 11:31:39.496290 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 561/1111] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:39 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:40.518671 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-e77187d9-6197-4c91-8c8c-9cfd83e43cca tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:40.519322 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-e77187d9-6197-4c91-8c8c-9cfd83e43cca tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:40.526009 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e77187d9-6197-4c91-8c8c-9cfd83e43cca tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:40.526487 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e77187d9-6197-4c91-8c8c-9cfd83e43cca tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:40.526946 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e77187d9-6197-4c91-8c8c-9cfd83e43cca tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:40.527634 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e77187d9-6197-4c91-8c8c-9cfd83e43cca tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:40.528083 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e77187d9-6197-4c91-8c8c-9cfd83e43cca tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:40.528508 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e77187d9-6197-4c91-8c8c-9cfd83e43cca tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:40.656491 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-e77187d9-6197-4c91-8c8c-9cfd83e43cca tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:40.664559 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-e77187d9-6197-4c91-8c8c-9cfd83e43cca tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1724 microversion: 2.1 time: 0.149774 Oct 26 11:31:40.665127 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 551/1112] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:40 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:41.011791 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-349c8884-92fa-4305-8ff0-b1e928be3caf tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:41.012312 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-349c8884-92fa-4305-8ff0-b1e928be3caf tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:41.019616 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-349c8884-92fa-4305-8ff0-b1e928be3caf tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:41.024058 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-349c8884-92fa-4305-8ff0-b1e928be3caf tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:41.024058 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-349c8884-92fa-4305-8ff0-b1e928be3caf tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:41.024058 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-349c8884-92fa-4305-8ff0-b1e928be3caf tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:41.024058 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-349c8884-92fa-4305-8ff0-b1e928be3caf tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:41.024538 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-349c8884-92fa-4305-8ff0-b1e928be3caf tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:41.046508 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-349c8884-92fa-4305-8ff0-b1e928be3caf tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Going to try to terminate instance {{(pid=119306) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 11:31:41.347719 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-349c8884-92fa-4305-8ff0-b1e928be3caf tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 204 len: 0 microversion: 2.1 time: 0.339423 Oct 26 11:31:41.348318 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 562/1113] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Oct 26 11:31:41 2022] DELETE /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 11:31:41.363708 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-34d49e6f-6656-4dc2-ab06-6987a90c9b54 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:41.364324 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-34d49e6f-6656-4dc2-ab06-6987a90c9b54 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:41.370175 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-34d49e6f-6656-4dc2-ab06-6987a90c9b54 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:41.370667 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-34d49e6f-6656-4dc2-ab06-6987a90c9b54 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:41.371143 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-34d49e6f-6656-4dc2-ab06-6987a90c9b54 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:41.371839 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-34d49e6f-6656-4dc2-ab06-6987a90c9b54 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:41.372293 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-34d49e6f-6656-4dc2-ab06-6987a90c9b54 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:41.372717 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-34d49e6f-6656-4dc2-ab06-6987a90c9b54 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:41.506590 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-34d49e6f-6656-4dc2-ab06-6987a90c9b54 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:41.514390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-34d49e6f-6656-4dc2-ab06-6987a90c9b54 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1555 microversion: 2.1 time: 0.157078 Oct 26 11:31:41.515021 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 552/1114] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:41 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:41.688895 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-7c8482ff-d2b3-4773-971a-bd7b11a7d3d9 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:41.689596 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-7c8482ff-d2b3-4773-971a-bd7b11a7d3d9 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:41.695407 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7c8482ff-d2b3-4773-971a-bd7b11a7d3d9 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:41.695884 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7c8482ff-d2b3-4773-971a-bd7b11a7d3d9 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:41.696324 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7c8482ff-d2b3-4773-971a-bd7b11a7d3d9 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:41.697026 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7c8482ff-d2b3-4773-971a-bd7b11a7d3d9 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:41.697474 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7c8482ff-d2b3-4773-971a-bd7b11a7d3d9 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:41.697891 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7c8482ff-d2b3-4773-971a-bd7b11a7d3d9 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:41.825954 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-7c8482ff-d2b3-4773-971a-bd7b11a7d3d9 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:41.834179 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-7c8482ff-d2b3-4773-971a-bd7b11a7d3d9 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1724 microversion: 2.1 time: 0.149529 Oct 26 11:31:41.834760 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 563/1115] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:41 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:42.537261 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-8155ff64-7a1a-4314-a6e9-30f7d30fc33a tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:42.537866 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-8155ff64-7a1a-4314-a6e9-30f7d30fc33a tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:42.544179 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8155ff64-7a1a-4314-a6e9-30f7d30fc33a tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:42.544657 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8155ff64-7a1a-4314-a6e9-30f7d30fc33a tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:42.545090 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8155ff64-7a1a-4314-a6e9-30f7d30fc33a tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:42.545774 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8155ff64-7a1a-4314-a6e9-30f7d30fc33a tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:42.546227 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8155ff64-7a1a-4314-a6e9-30f7d30fc33a tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:42.546644 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8155ff64-7a1a-4314-a6e9-30f7d30fc33a tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:42.671025 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-8155ff64-7a1a-4314-a6e9-30f7d30fc33a tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:42.679508 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-8155ff64-7a1a-4314-a6e9-30f7d30fc33a tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1555 microversion: 2.1 time: 0.145667 Oct 26 11:31:42.679833 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 553/1116] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:42 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1555 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:42.857809 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-69fd81a0-231c-4329-821a-aa443b6bfae2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:42.858441 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-69fd81a0-231c-4329-821a-aa443b6bfae2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:42.865730 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-69fd81a0-231c-4329-821a-aa443b6bfae2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:42.866224 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-69fd81a0-231c-4329-821a-aa443b6bfae2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:42.866667 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-69fd81a0-231c-4329-821a-aa443b6bfae2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:42.867389 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-69fd81a0-231c-4329-821a-aa443b6bfae2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:42.867844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-69fd81a0-231c-4329-821a-aa443b6bfae2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:42.868271 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-69fd81a0-231c-4329-821a-aa443b6bfae2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:42.872351 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:31:42.995623 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-69fd81a0-231c-4329-821a-aa443b6bfae2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:43.004273 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-69fd81a0-231c-4329-821a-aa443b6bfae2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1724 microversion: 2.1 time: 0.150305 Oct 26 11:31:43.004768 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 564/1117] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:42 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:43.702755 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-45ce61ae-9c4e-4868-9d29-7a71785cc2f7 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:43.703397 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-45ce61ae-9c4e-4868-9d29-7a71785cc2f7 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:43.710276 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-45ce61ae-9c4e-4868-9d29-7a71785cc2f7 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:43.710764 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-45ce61ae-9c4e-4868-9d29-7a71785cc2f7 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:43.711231 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-45ce61ae-9c4e-4868-9d29-7a71785cc2f7 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:43.711916 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-45ce61ae-9c4e-4868-9d29-7a71785cc2f7 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:43.712368 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-45ce61ae-9c4e-4868-9d29-7a71785cc2f7 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:43.712790 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-45ce61ae-9c4e-4868-9d29-7a71785cc2f7 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:43.840898 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-45ce61ae-9c4e-4868-9d29-7a71785cc2f7 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:43.844497 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:31:43.849415 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-45ce61ae-9c4e-4868-9d29-7a71785cc2f7 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1555 microversion: 2.1 time: 0.150523 Oct 26 11:31:43.849977 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 554/1118] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:43 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:44.028141 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-fc0a4df3-a3c7-4920-8f4b-46a2371c77fd tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:44.028746 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-fc0a4df3-a3c7-4920-8f4b-46a2371c77fd tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:44.035794 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fc0a4df3-a3c7-4920-8f4b-46a2371c77fd tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:44.036389 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fc0a4df3-a3c7-4920-8f4b-46a2371c77fd tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:44.036824 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fc0a4df3-a3c7-4920-8f4b-46a2371c77fd tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:44.037513 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fc0a4df3-a3c7-4920-8f4b-46a2371c77fd tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:44.037964 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fc0a4df3-a3c7-4920-8f4b-46a2371c77fd tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:44.038516 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-fc0a4df3-a3c7-4920-8f4b-46a2371c77fd tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:44.171898 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-fc0a4df3-a3c7-4920-8f4b-46a2371c77fd tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:44.180470 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-fc0a4df3-a3c7-4920-8f4b-46a2371c77fd tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1724 microversion: 2.1 time: 0.156838 Oct 26 11:31:44.181041 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 565/1119] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:44 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:31:44.873206 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-6915e7f9-6cf4-49c7-a641-1563a8478dae tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:44.873824 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-6915e7f9-6cf4-49c7-a641-1563a8478dae tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:44.880888 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6915e7f9-6cf4-49c7-a641-1563a8478dae tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:44.881371 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6915e7f9-6cf4-49c7-a641-1563a8478dae tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:44.881810 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6915e7f9-6cf4-49c7-a641-1563a8478dae tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:44.882508 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6915e7f9-6cf4-49c7-a641-1563a8478dae tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:44.883006 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6915e7f9-6cf4-49c7-a641-1563a8478dae tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:44.883435 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6915e7f9-6cf4-49c7-a641-1563a8478dae tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:45.007648 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-6915e7f9-6cf4-49c7-a641-1563a8478dae tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:45.015254 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-6915e7f9-6cf4-49c7-a641-1563a8478dae tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1555 microversion: 2.1 time: 0.145869 Oct 26 11:31:45.015818 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 555/1120] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:44 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1555 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:45.203862 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-5e6bbdf4-2a00-4289-a6d8-f444376453f8 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:45.204398 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-5e6bbdf4-2a00-4289-a6d8-f444376453f8 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:45.210676 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5e6bbdf4-2a00-4289-a6d8-f444376453f8 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:45.211186 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5e6bbdf4-2a00-4289-a6d8-f444376453f8 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:45.211615 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5e6bbdf4-2a00-4289-a6d8-f444376453f8 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:45.212295 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5e6bbdf4-2a00-4289-a6d8-f444376453f8 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:45.212740 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5e6bbdf4-2a00-4289-a6d8-f444376453f8 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:45.213155 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5e6bbdf4-2a00-4289-a6d8-f444376453f8 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:45.338443 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-5e6bbdf4-2a00-4289-a6d8-f444376453f8 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:45.347152 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-5e6bbdf4-2a00-4289-a6d8-f444376453f8 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1724 microversion: 2.1 time: 0.147128 Oct 26 11:31:45.347715 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 566/1121] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:45 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:31:46.039541 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-35e88ed7-4d9a-43bf-9f4d-e2e05b3305d0 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:46.040148 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-35e88ed7-4d9a-43bf-9f4d-e2e05b3305d0 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:46.046541 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-35e88ed7-4d9a-43bf-9f4d-e2e05b3305d0 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:46.047052 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-35e88ed7-4d9a-43bf-9f4d-e2e05b3305d0 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:46.047486 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-35e88ed7-4d9a-43bf-9f4d-e2e05b3305d0 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:46.048808 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-35e88ed7-4d9a-43bf-9f4d-e2e05b3305d0 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:46.049268 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-35e88ed7-4d9a-43bf-9f4d-e2e05b3305d0 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:46.049690 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-35e88ed7-4d9a-43bf-9f4d-e2e05b3305d0 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:46.174648 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-35e88ed7-4d9a-43bf-9f4d-e2e05b3305d0 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:46.185160 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-35e88ed7-4d9a-43bf-9f4d-e2e05b3305d0 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1555 microversion: 2.1 time: 0.146549 Oct 26 11:31:46.185160 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 556/1122] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:46 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1555 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:46.370837 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-5ff0b53d-139e-4f9f-859e-586a5bd4d6e7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:46.371451 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-5ff0b53d-139e-4f9f-859e-586a5bd4d6e7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:46.378340 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5ff0b53d-139e-4f9f-859e-586a5bd4d6e7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:46.378908 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5ff0b53d-139e-4f9f-859e-586a5bd4d6e7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:46.379360 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5ff0b53d-139e-4f9f-859e-586a5bd4d6e7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:46.380038 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5ff0b53d-139e-4f9f-859e-586a5bd4d6e7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:46.380490 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5ff0b53d-139e-4f9f-859e-586a5bd4d6e7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:46.380910 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5ff0b53d-139e-4f9f-859e-586a5bd4d6e7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:46.509806 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-5ff0b53d-139e-4f9f-859e-586a5bd4d6e7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:46.518193 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-5ff0b53d-139e-4f9f-859e-586a5bd4d6e7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1724 microversion: 2.1 time: 0.151232 Oct 26 11:31:46.519037 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 567/1123] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:46 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:47.206391 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-1c59d090-0d17-4524-8761-fb4c93be0141 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:47.207142 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-1c59d090-0d17-4524-8761-fb4c93be0141 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:47.213627 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1c59d090-0d17-4524-8761-fb4c93be0141 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:47.214282 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1c59d090-0d17-4524-8761-fb4c93be0141 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:47.214795 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1c59d090-0d17-4524-8761-fb4c93be0141 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:47.215800 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1c59d090-0d17-4524-8761-fb4c93be0141 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:47.216350 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1c59d090-0d17-4524-8761-fb4c93be0141 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:47.216840 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1c59d090-0d17-4524-8761-fb4c93be0141 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:47.351346 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-1c59d090-0d17-4524-8761-fb4c93be0141 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:47.359483 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-1c59d090-0d17-4524-8761-fb4c93be0141 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1555 microversion: 2.1 time: 0.157621 Oct 26 11:31:47.360152 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 557/1124] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:47 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:47.541958 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-3e9c5dfa-350c-4204-8cc1-35de0fc22a89 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:47.542577 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-3e9c5dfa-350c-4204-8cc1-35de0fc22a89 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:47.549135 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3e9c5dfa-350c-4204-8cc1-35de0fc22a89 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:47.549747 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3e9c5dfa-350c-4204-8cc1-35de0fc22a89 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:47.550188 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3e9c5dfa-350c-4204-8cc1-35de0fc22a89 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:47.551106 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3e9c5dfa-350c-4204-8cc1-35de0fc22a89 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:47.551733 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3e9c5dfa-350c-4204-8cc1-35de0fc22a89 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:47.552160 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3e9c5dfa-350c-4204-8cc1-35de0fc22a89 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:47.554207 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-63deb868-5974-4314-971f-e18993de24a4 req-d554cffe-d243-4d00-9f93-b8d27edef60e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbf3d5fd-8067-49a1-b4e3-51f5949018d5", "name": "network-vif-deleted", "tag": "436d699c-83eb-4925-85b5-851f53994190"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:31:47.563223 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-63deb868-5974-4314-971f-e18993de24a4 req-d554cffe-d243-4d00-9f93-b8d27edef60e service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:47.563700 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-63deb868-5974-4314-971f-e18993de24a4 req-d554cffe-d243-4d00-9f93-b8d27edef60e service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:47.564613 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-63deb868-5974-4314-971f-e18993de24a4 req-d554cffe-d243-4d00-9f93-b8d27edef60e service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:47.575717 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-63deb868-5974-4314-971f-e18993de24a4 req-d554cffe-d243-4d00-9f93-b8d27edef60e service nova] Creating event network-vif-deleted:436d699c-83eb-4925-85b5-851f53994190 for instance cbf3d5fd-8067-49a1-b4e3-51f5949018d5 on hv-cinder-81558 Oct 26 11:31:47.581406 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-63deb868-5974-4314-971f-e18993de24a4 req-d554cffe-d243-4d00-9f93-b8d27edef60e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031070 Oct 26 11:31:47.582003 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 558/1125] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:31:47.684581 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-3e9c5dfa-350c-4204-8cc1-35de0fc22a89 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:47.693491 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-3e9c5dfa-350c-4204-8cc1-35de0fc22a89 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1724 microversion: 2.1 time: 0.155626 Oct 26 11:31:47.694056 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 568/1126] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:47 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:48.384451 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-12471269-bbf4-4120-b219-1f08e461acec tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:48.385072 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-12471269-bbf4-4120-b219-1f08e461acec tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:48.391116 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-12471269-bbf4-4120-b219-1f08e461acec tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:48.391592 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-12471269-bbf4-4120-b219-1f08e461acec tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:48.392025 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-12471269-bbf4-4120-b219-1f08e461acec tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:48.392704 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-12471269-bbf4-4120-b219-1f08e461acec tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:48.393160 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-12471269-bbf4-4120-b219-1f08e461acec tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:48.393571 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-12471269-bbf4-4120-b219-1f08e461acec tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:48.454234 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-12471269-bbf4-4120-b219-1f08e461acec tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:48.461820 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-12471269-bbf4-4120-b219-1f08e461acec tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1513 microversion: 2.1 time: 0.082124 Oct 26 11:31:48.462378 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 559/1127] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:48 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1513 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:48.718906 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-dc5131d1-08de-4588-8053-c36cb8cae111 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:48.719440 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-dc5131d1-08de-4588-8053-c36cb8cae111 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:48.726350 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dc5131d1-08de-4588-8053-c36cb8cae111 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:48.726862 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dc5131d1-08de-4588-8053-c36cb8cae111 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:48.727310 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dc5131d1-08de-4588-8053-c36cb8cae111 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:48.728006 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dc5131d1-08de-4588-8053-c36cb8cae111 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:48.728459 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dc5131d1-08de-4588-8053-c36cb8cae111 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:48.728884 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-dc5131d1-08de-4588-8053-c36cb8cae111 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:48.854171 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-dc5131d1-08de-4588-8053-c36cb8cae111 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:48.862330 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-dc5131d1-08de-4588-8053-c36cb8cae111 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1724 microversion: 2.1 time: 0.147374 Oct 26 11:31:48.862929 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 569/1128] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:48 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:49.484774 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-1712d93a-d5e1-4fde-9060-27e908fd8553 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:49.485382 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-1712d93a-d5e1-4fde-9060-27e908fd8553 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:49.492168 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1712d93a-d5e1-4fde-9060-27e908fd8553 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:49.492644 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1712d93a-d5e1-4fde-9060-27e908fd8553 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:49.493104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1712d93a-d5e1-4fde-9060-27e908fd8553 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:49.493784 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1712d93a-d5e1-4fde-9060-27e908fd8553 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:49.494232 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1712d93a-d5e1-4fde-9060-27e908fd8553 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:49.494656 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1712d93a-d5e1-4fde-9060-27e908fd8553 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:49.554320 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-1712d93a-d5e1-4fde-9060-27e908fd8553 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:49.561817 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-1712d93a-d5e1-4fde-9060-27e908fd8553 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1513 microversion: 2.1 time: 0.080985 Oct 26 11:31:49.562374 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 560/1129] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:49 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1513 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:49.885026 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-5ce6940d-ef90-4b8f-be5b-17bcea87ca38 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:49.885663 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-5ce6940d-ef90-4b8f-be5b-17bcea87ca38 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:49.887974 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:31:49.892672 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5ce6940d-ef90-4b8f-be5b-17bcea87ca38 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:49.893149 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5ce6940d-ef90-4b8f-be5b-17bcea87ca38 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:49.896468 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5ce6940d-ef90-4b8f-be5b-17bcea87ca38 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:49.896468 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5ce6940d-ef90-4b8f-be5b-17bcea87ca38 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:49.896468 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5ce6940d-ef90-4b8f-be5b-17bcea87ca38 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:49.896468 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5ce6940d-ef90-4b8f-be5b-17bcea87ca38 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:50.021939 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-5ce6940d-ef90-4b8f-be5b-17bcea87ca38 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:50.030308 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-5ce6940d-ef90-4b8f-be5b-17bcea87ca38 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1724 microversion: 2.1 time: 0.149109 Oct 26 11:31:50.033994 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 570/1130] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:49 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:31:50.585783 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-016bbb3b-f9cd-4772-80d5-915e8548a37c tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:50.586389 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-016bbb3b-f9cd-4772-80d5-915e8548a37c tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:50.592994 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-016bbb3b-f9cd-4772-80d5-915e8548a37c tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:50.593474 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-016bbb3b-f9cd-4772-80d5-915e8548a37c tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:50.593903 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-016bbb3b-f9cd-4772-80d5-915e8548a37c tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:50.594672 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-016bbb3b-f9cd-4772-80d5-915e8548a37c tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:50.595151 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-016bbb3b-f9cd-4772-80d5-915e8548a37c tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:50.595584 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-016bbb3b-f9cd-4772-80d5-915e8548a37c tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:50.659227 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-016bbb3b-f9cd-4772-80d5-915e8548a37c tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:50.666798 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-016bbb3b-f9cd-4772-80d5-915e8548a37c tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1513 microversion: 2.1 time: 0.084939 Oct 26 11:31:50.667386 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 561/1131] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:50 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1513 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:51.053555 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-922c04de-431e-43ce-98dd-7c749e75de64 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:51.054168 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-922c04de-431e-43ce-98dd-7c749e75de64 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:51.060677 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-922c04de-431e-43ce-98dd-7c749e75de64 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:51.061164 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-922c04de-431e-43ce-98dd-7c749e75de64 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:51.061603 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-922c04de-431e-43ce-98dd-7c749e75de64 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:51.062291 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-922c04de-431e-43ce-98dd-7c749e75de64 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:51.062760 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-922c04de-431e-43ce-98dd-7c749e75de64 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:51.063206 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-922c04de-431e-43ce-98dd-7c749e75de64 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:51.191949 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-922c04de-431e-43ce-98dd-7c749e75de64 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:51.200081 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-922c04de-431e-43ce-98dd-7c749e75de64 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1724 microversion: 2.1 time: 0.150499 Oct 26 11:31:51.200650 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 571/1132] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:51 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:51.690537 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-b7dd8ca4-ba51-4575-b8dc-5d85d51dff6d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:51.691226 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-b7dd8ca4-ba51-4575-b8dc-5d85d51dff6d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:51.697703 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b7dd8ca4-ba51-4575-b8dc-5d85d51dff6d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:51.698181 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b7dd8ca4-ba51-4575-b8dc-5d85d51dff6d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:51.698618 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b7dd8ca4-ba51-4575-b8dc-5d85d51dff6d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:51.699407 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b7dd8ca4-ba51-4575-b8dc-5d85d51dff6d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:51.699852 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b7dd8ca4-ba51-4575-b8dc-5d85d51dff6d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:51.700274 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b7dd8ca4-ba51-4575-b8dc-5d85d51dff6d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:51.762461 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-b7dd8ca4-ba51-4575-b8dc-5d85d51dff6d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:51.770164 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-b7dd8ca4-ba51-4575-b8dc-5d85d51dff6d tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1344 microversion: 2.1 time: 0.084147 Oct 26 11:31:51.770707 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 562/1133] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:51 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1344 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:52.224213 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-b57c0a0a-2676-40a9-900c-b53476d8e26a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:52.224827 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-b57c0a0a-2676-40a9-900c-b53476d8e26a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:52.231135 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b57c0a0a-2676-40a9-900c-b53476d8e26a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:52.231628 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b57c0a0a-2676-40a9-900c-b53476d8e26a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:52.232067 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b57c0a0a-2676-40a9-900c-b53476d8e26a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:52.232809 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b57c0a0a-2676-40a9-900c-b53476d8e26a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:52.233262 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b57c0a0a-2676-40a9-900c-b53476d8e26a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:52.233684 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b57c0a0a-2676-40a9-900c-b53476d8e26a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:52.366672 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-b57c0a0a-2676-40a9-900c-b53476d8e26a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:52.376008 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-b57c0a0a-2676-40a9-900c-b53476d8e26a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1724 microversion: 2.1 time: 0.155164 Oct 26 11:31:52.376008 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 572/1134] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:52 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:52.793304 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-c512b0ce-1565-44eb-8425-f6e1792365a4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:52.793917 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-c512b0ce-1565-44eb-8425-f6e1792365a4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:52.800413 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c512b0ce-1565-44eb-8425-f6e1792365a4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:52.800895 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c512b0ce-1565-44eb-8425-f6e1792365a4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:52.801334 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c512b0ce-1565-44eb-8425-f6e1792365a4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:52.802021 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c512b0ce-1565-44eb-8425-f6e1792365a4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:52.802474 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c512b0ce-1565-44eb-8425-f6e1792365a4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:52.802925 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c512b0ce-1565-44eb-8425-f6e1792365a4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:52.837980 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c512b0ce-1565-44eb-8425-f6e1792365a4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:52.838461 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c512b0ce-1565-44eb-8425-f6e1792365a4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:52.838963 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c512b0ce-1565-44eb-8425-f6e1792365a4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:52.839423 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.objects.instance [None req-c512b0ce-1565-44eb-8425-f6e1792365a4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lazy-loading 'fault' on Instance uuid cbf3d5fd-8067-49a1-b4e3-51f5949018d5 {{(pid=119305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:31:52.882120 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-c512b0ce-1565-44eb-8425-f6e1792365a4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7088cf9374c4e7d8e60c34a782fb42f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a975701f3c69481b874e106eb5d4edcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:52.889993 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-c512b0ce-1565-44eb-8425-f6e1792365a4 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 200 len: 1349 microversion: 2.1 time: 0.100556 Oct 26 11:31:52.890608 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 563/1135] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:52 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 1349 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:53.397369 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-2d792262-c778-4e6b-bd10-142c01d438b7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:53.398062 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-2d792262-c778-4e6b-bd10-142c01d438b7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:53.404926 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2d792262-c778-4e6b-bd10-142c01d438b7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:53.405410 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2d792262-c778-4e6b-bd10-142c01d438b7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:53.405840 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2d792262-c778-4e6b-bd10-142c01d438b7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:53.406532 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2d792262-c778-4e6b-bd10-142c01d438b7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:53.407007 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2d792262-c778-4e6b-bd10-142c01d438b7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:53.407424 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-2d792262-c778-4e6b-bd10-142c01d438b7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:53.537259 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-2d792262-c778-4e6b-bd10-142c01d438b7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:53.545533 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-2d792262-c778-4e6b-bd10-142c01d438b7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1724 microversion: 2.1 time: 0.152092 Oct 26 11:31:53.546101 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 573/1136] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:53 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:53.913539 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-0d5401b5-969f-4e58-9bec-c14227b0da0b tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:53.914137 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-0d5401b5-969f-4e58-9bec-c14227b0da0b tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] [instance: cbf3d5fd-8067-49a1-b4e3-51f5949018d5] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:53.916581 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_api:SELECT=53 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:31:53.921271 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0d5401b5-969f-4e58-9bec-c14227b0da0b tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:53.921759 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0d5401b5-969f-4e58-9bec-c14227b0da0b tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:53.922248 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0d5401b5-969f-4e58-9bec-c14227b0da0b tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:53.922968 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0d5401b5-969f-4e58-9bec-c14227b0da0b tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:53.925327 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0d5401b5-969f-4e58-9bec-c14227b0da0b tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:53.925327 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0d5401b5-969f-4e58-9bec-c14227b0da0b tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:53.937750 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.wsgi [None req-0d5401b5-969f-4e58-9bec-c14227b0da0b tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] HTTP exception thrown: Instance cbf3d5fd-8067-49a1-b4e3-51f5949018d5 could not be found. Oct 26 11:31:53.939409 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-0d5401b5-969f-4e58-9bec-c14227b0da0b tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Request method failure captured: Oct 26 11:31:53.939409 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: request: GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 HTTP/1.1 Oct 26 11:31:53.939409 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept: application/json Oct 26 11:31:53.939409 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept-Encoding: identity Oct 26 11:31:53.939409 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Connection: close Oct 26 11:31:53.939409 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Length: 0 Oct 26 11:31:53.939409 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Type: application/json Oct 26 11:31:53.939409 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Host: 10.222.0.42 Oct 26 11:31:53.939409 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Openstack-System-Scope: None Oct 26 11:31:53.939409 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: User-Agent: python-urllib3/1.26.12 Oct 26 11:31:53.939409 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Auth-Token: gAAAAABjWRmsHCasD_Ad81_f27sT9kh0u7hq0prBbqPA99gQiu9QD0uFLglMfEHiLDw8VN4NdfGUwBvKV4yEpZCW_sue8DQawMLWlCyym89Diuhe2F8c4CI-K3BsDxaLA00DpnG9HFALZ8vouZUFuKjyCAKInBqZBMbTT7YUGTyjaqyi4qlDv88 Oct 26 11:31:53.939409 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Id: None Oct 26 11:31:53.939409 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Name: None Oct 26 11:31:53.939409 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Identity-Status: Confirmed Oct 26 11:31:53.939409 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Is-Admin-Project: True Oct 26 11:31:53.939409 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Id: default Oct 26 11:31:53.939409 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Name: Default Oct 26 11:31:53.939409 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Id: a975701f3c69481b874e106eb5d4edcd Oct 26 11:31:53.939409 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Name: tempest-TestMinimumBasicScenario-1084096257 Oct 26 11:31:53.939409 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Role: member,reader Oct 26 11:31:53.939409 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Roles: member,reader Oct 26 11:31:53.941798 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a975701f3c69481b874e106eb5d4edcd", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a975701f3c69481b874e106eb5d4edcd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a975701f3c69481b874e106eb5d4edcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a975701f3c69481b874e106eb5d4edcd"}]}] Oct 26 11:31:53.941798 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant: tempest-TestMinimumBasicScenario-1084096257 Oct 26 11:31:53.941798 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Id: a975701f3c69481b874e106eb5d4edcd Oct 26 11:31:53.941798 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1084096257 Oct 26 11:31:53.941798 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User: tempest-TestMinimumBasicScenario-1084096257-project Oct 26 11:31:53.941798 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Id: default Oct 26 11:31:53.941798 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Name: Default Oct 26 11:31:53.941798 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Id: e7088cf9374c4e7d8e60c34a782fb42f Oct 26 11:31:53.941798 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Name: tempest-TestMinimumBasicScenario-1084096257-project Oct 26 11:31:53.941798 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: method: > Oct 26 11:31:53.941798 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: exception: Instance cbf3d5fd-8067-49a1-b4e3-51f5949018d5 could not be found. Oct 26 11:31:53.941798 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: action_args: {'id': 'cbf3d5fd-8067-49a1-b4e3-51f5949018d5'} Oct 26 11:31:53.942779 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:31:53.942779 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:31:53.942779 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:31:53.942779 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:31:53.942779 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:31:53.942779 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:31:53.942779 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:31:53.942779 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:31:53.942779 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:31:53.942779 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:31:53.942779 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbf3d5fd-8067-49a1-b4e3-51f5949018d5 could not be found. Oct 26 11:31:53.942779 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:31:53.942779 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:31:53.942779 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:31:53.942779 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:31:53.942779 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:31:53.942779 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:31:53.942779 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:31:53.942779 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:31:53.942779 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:31:53.944391 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:31:53.944391 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 11:31:53.944391 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 11:31:53.944391 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:31:53.944391 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:31:53.944391 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:31:53.944391 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:31:53.944391 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbf3d5fd-8067-49a1-b4e3-51f5949018d5 could not be found. Oct 26 11:31:53.944391 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:31:53.944391 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:31:53.944391 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:31:53.944391 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:31:53.944391 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:31:53.944391 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:31:53.944391 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:31:53.944391 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:31:53.944391 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbf3d5fd-8067-49a1-b4e3-51f5949018d5 could not be found. Oct 26 11:31:53.944391 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:31:53.945734 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-0d5401b5-969f-4e58-9bec-c14227b0da0b tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Returning 404 to user: Instance cbf3d5fd-8067-49a1-b4e3-51f5949018d5 could not be found. {{(pid=119305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:31:53.945734 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-0d5401b5-969f-4e58-9bec-c14227b0da0b tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5" status: 404 len: 111 microversion: 2.1 time: 0.031799 Oct 26 11:31:53.945734 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 564/1137] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:53 2022] GET /compute/v2.1/servers/cbf3d5fd-8067-49a1-b4e3-51f5949018d5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:31:53.950156 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-4692f8d2-adaa-4a37-aa68-d2407e5e3596 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] Calling method '.version_select at 0x7f6b937a63a0>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:54.048207 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-4692f8d2-adaa-4a37-aa68-d2407e5e3596 tempest-TestMinimumBasicScenario-1084096257 tempest-TestMinimumBasicScenario-1084096257-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1874612399" status: 202 len: 0 microversion: 2.1 time: 0.101763 Oct 26 11:31:54.048803 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 574/1138] 10.222.0.42 () {58 vars in 1272 bytes} [Wed Oct 26 11:31:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1874612399 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 11:31:54.570064 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-b4ab70a7-0106-4bbb-be26-8ae20654135e tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:54.570570 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-b4ab70a7-0106-4bbb-be26-8ae20654135e tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:54.578463 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b4ab70a7-0106-4bbb-be26-8ae20654135e tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:54.578463 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b4ab70a7-0106-4bbb-be26-8ae20654135e tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:54.578463 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b4ab70a7-0106-4bbb-be26-8ae20654135e tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:54.579315 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b4ab70a7-0106-4bbb-be26-8ae20654135e tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:54.579609 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b4ab70a7-0106-4bbb-be26-8ae20654135e tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:54.579975 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b4ab70a7-0106-4bbb-be26-8ae20654135e tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:54.708707 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-b4ab70a7-0106-4bbb-be26-8ae20654135e tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:54.716957 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-b4ab70a7-0106-4bbb-be26-8ae20654135e tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1724 microversion: 2.1 time: 0.151175 Oct 26 11:31:54.717511 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 565/1139] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:54 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:55.745769 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-8c3b1089-1c93-4df8-93a0-4517e2d2cd9b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:55.747231 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-8c3b1089-1c93-4df8-93a0-4517e2d2cd9b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:55.755783 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8c3b1089-1c93-4df8-93a0-4517e2d2cd9b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:55.756725 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8c3b1089-1c93-4df8-93a0-4517e2d2cd9b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:55.757204 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8c3b1089-1c93-4df8-93a0-4517e2d2cd9b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:55.759299 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8c3b1089-1c93-4df8-93a0-4517e2d2cd9b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:55.759766 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8c3b1089-1c93-4df8-93a0-4517e2d2cd9b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:55.760197 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8c3b1089-1c93-4df8-93a0-4517e2d2cd9b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:55.891986 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-8c3b1089-1c93-4df8-93a0-4517e2d2cd9b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:55.901196 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-8c3b1089-1c93-4df8-93a0-4517e2d2cd9b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1724 microversion: 2.1 time: 0.164146 Oct 26 11:31:55.901789 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 575/1140] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:55 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:56.805497 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-fa19143b-6a05-4233-a77a-60ddbcc9ac26 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:56.806029 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-fa19143b-6a05-4233-a77a-60ddbcc9ac26 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:56.812939 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fa19143b-6a05-4233-a77a-60ddbcc9ac26 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:56.813435 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fa19143b-6a05-4233-a77a-60ddbcc9ac26 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:56.813874 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fa19143b-6a05-4233-a77a-60ddbcc9ac26 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:56.814581 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fa19143b-6a05-4233-a77a-60ddbcc9ac26 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:56.815300 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fa19143b-6a05-4233-a77a-60ddbcc9ac26 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:56.815727 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-fa19143b-6a05-4233-a77a-60ddbcc9ac26 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:56.911594 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.objects.instance [None req-fa19143b-6a05-4233-a77a-60ddbcc9ac26 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lazy-loading 'services' on Instance uuid 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c {{(pid=119305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:31:56.925395 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-0d56b86a-de90-4fc2-a8e1-e608d21ea0ab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:56.926108 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-0d56b86a-de90-4fc2-a8e1-e608d21ea0ab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:56.943755 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0d56b86a-de90-4fc2-a8e1-e608d21ea0ab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:56.943755 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0d56b86a-de90-4fc2-a8e1-e608d21ea0ab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:56.943755 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0d56b86a-de90-4fc2-a8e1-e608d21ea0ab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:56.943755 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0d56b86a-de90-4fc2-a8e1-e608d21ea0ab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:56.944131 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0d56b86a-de90-4fc2-a8e1-e608d21ea0ab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:56.944131 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0d56b86a-de90-4fc2-a8e1-e608d21ea0ab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:57.124828 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-fa19143b-6a05-4233-a77a-60ddbcc9ac26 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c/os-volume_attachments/c049a1de-9a4b-4d0b-9b5f-dca9dca5c2ad" status: 202 len: 0 microversion: 2.1 time: 0.319111 Oct 26 11:31:57.126747 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 566/1141] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Oct 26 11:31:56 2022] DELETE /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c/os-volume_attachments/c049a1de-9a4b-4d0b-9b5f-dca9dca5c2ad => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 11:31:57.200596 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-0d56b86a-de90-4fc2-a8e1-e608d21ea0ab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:57.213744 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-0d56b86a-de90-4fc2-a8e1-e608d21ea0ab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1701 microversion: 2.1 time: 0.292825 Oct 26 11:31:57.226840 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 576/1142] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:56 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1701 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:57.241932 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-af101b45-d17c-404a-a815-f86017ea2901 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:31:57.250961 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-af101b45-d17c-404a-a815-f86017ea2901 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:57.251456 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-af101b45-d17c-404a-a815-f86017ea2901 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:57.251897 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-af101b45-d17c-404a-a815-f86017ea2901 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:57.319201 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-af101b45-d17c-404a-a815-f86017ea2901 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Going to try to start instance {{(pid=119305) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 26 11:31:57.491301 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-af101b45-d17c-404a-a815-f86017ea2901 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "POST /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3/action" status: 202 len: 0 microversion: 2.1 time: 0.255670 Oct 26 11:31:57.492285 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 567/1143] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Oct 26 11:31:57 2022] POST /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 11:31:57.500374 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-95b06a57-d650-4373-9800-d36118e6c1da tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:57.501172 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-95b06a57-d650-4373-9800-d36118e6c1da tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:57.507324 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-95b06a57-d650-4373-9800-d36118e6c1da tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:57.507806 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-95b06a57-d650-4373-9800-d36118e6c1da tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:57.508241 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-95b06a57-d650-4373-9800-d36118e6c1da tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:57.508946 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-95b06a57-d650-4373-9800-d36118e6c1da tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:57.509385 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-95b06a57-d650-4373-9800-d36118e6c1da tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:57.509807 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-95b06a57-d650-4373-9800-d36118e6c1da tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:57.731344 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-95b06a57-d650-4373-9800-d36118e6c1da tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:57.741544 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-95b06a57-d650-4373-9800-d36118e6c1da tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1710 microversion: 2.1 time: 0.245006 Oct 26 11:31:57.748421 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 577/1144] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:57 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1710 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:58.284362 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-685f67ea-53e4-42f9-93a8-03835cdc9e5b tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:58.284871 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-685f67ea-53e4-42f9-93a8-03835cdc9e5b tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:58.291222 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-685f67ea-53e4-42f9-93a8-03835cdc9e5b tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:58.291708 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-685f67ea-53e4-42f9-93a8-03835cdc9e5b tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:58.292146 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-685f67ea-53e4-42f9-93a8-03835cdc9e5b tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:58.292934 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-685f67ea-53e4-42f9-93a8-03835cdc9e5b tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:58.293399 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-685f67ea-53e4-42f9-93a8-03835cdc9e5b tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:58.293831 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-685f67ea-53e4-42f9-93a8-03835cdc9e5b tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:58.322621 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-685f67ea-53e4-42f9-93a8-03835cdc9e5b tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c] Going to try to terminate instance {{(pid=119305) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 11:31:58.682384 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-685f67ea-53e4-42f9-93a8-03835cdc9e5b tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c" status: 204 len: 0 microversion: 2.1 time: 0.403093 Oct 26 11:31:58.683087 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 568/1145] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Oct 26 11:31:58 2022] DELETE /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 26 11:31:58.697788 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-df51f3d8-d949-4c8e-a14d-1f780862a8ab tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:58.700102 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-df51f3d8-d949-4c8e-a14d-1f780862a8ab tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:58.707188 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-df51f3d8-d949-4c8e-a14d-1f780862a8ab tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:58.707674 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-df51f3d8-d949-4c8e-a14d-1f780862a8ab tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:58.708114 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-df51f3d8-d949-4c8e-a14d-1f780862a8ab tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:58.708852 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-df51f3d8-d949-4c8e-a14d-1f780862a8ab tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:58.709301 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-df51f3d8-d949-4c8e-a14d-1f780862a8ab tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:58.709753 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-df51f3d8-d949-4c8e-a14d-1f780862a8ab tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:58.766689 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-1b734dd8-bd94-4194-aa96-d9d729e13619 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:58.767876 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-1b734dd8-bd94-4194-aa96-d9d729e13619 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:58.774294 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1b734dd8-bd94-4194-aa96-d9d729e13619 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:58.775150 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1b734dd8-bd94-4194-aa96-d9d729e13619 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:58.776068 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1b734dd8-bd94-4194-aa96-d9d729e13619 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:58.777370 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1b734dd8-bd94-4194-aa96-d9d729e13619 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:58.778089 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1b734dd8-bd94-4194-aa96-d9d729e13619 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:58.778987 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1b734dd8-bd94-4194-aa96-d9d729e13619 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:58.785390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:31:58.954674 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-1b734dd8-bd94-4194-aa96-d9d729e13619 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:58.965149 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-1b734dd8-bd94-4194-aa96-d9d729e13619 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1710 microversion: 2.1 time: 0.202706 Oct 26 11:31:58.966508 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 569/1146] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:58 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1710 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:31:58.984928 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-df51f3d8-d949-4c8e-a14d-1f780862a8ab tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18665db956ab4da28230c4c2bfe8ffa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044799c63ce94aa39ea143e1633e2002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:31:58.992610 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-df51f3d8-d949-4c8e-a14d-1f780862a8ab tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c" status: 200 len: 1512 microversion: 2.1 time: 0.301279 Oct 26 11:31:58.993190 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 578/1147] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:58 2022] GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c => generated 1512 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:31:59.990252 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-b675dad9-b785-44f2-9ae0-bf7c89b41994 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:31:59.990899 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-b675dad9-b785-44f2-9ae0-bf7c89b41994 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:31:59.998220 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b675dad9-b785-44f2-9ae0-bf7c89b41994 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:31:59.998711 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b675dad9-b785-44f2-9ae0-bf7c89b41994 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:31:59.999176 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b675dad9-b785-44f2-9ae0-bf7c89b41994 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:31:59.999912 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b675dad9-b785-44f2-9ae0-bf7c89b41994 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:00.000380 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b675dad9-b785-44f2-9ae0-bf7c89b41994 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:00.000803 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-b675dad9-b785-44f2-9ae0-bf7c89b41994 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:00.015798 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-0a453a9a-b7b2-4f75-a3c8-e7a466003f5f tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:32:00.017226 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-0a453a9a-b7b2-4f75-a3c8-e7a466003f5f tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:32:00.024549 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0a453a9a-b7b2-4f75-a3c8-e7a466003f5f tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:00.025151 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0a453a9a-b7b2-4f75-a3c8-e7a466003f5f tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:00.025933 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0a453a9a-b7b2-4f75-a3c8-e7a466003f5f tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:00.026719 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0a453a9a-b7b2-4f75-a3c8-e7a466003f5f tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:00.027295 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0a453a9a-b7b2-4f75-a3c8-e7a466003f5f tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:00.027812 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-0a453a9a-b7b2-4f75-a3c8-e7a466003f5f tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:00.158664 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-0a453a9a-b7b2-4f75-a3c8-e7a466003f5f tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18665db956ab4da28230c4c2bfe8ffa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044799c63ce94aa39ea143e1633e2002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:32:00.167063 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-0a453a9a-b7b2-4f75-a3c8-e7a466003f5f tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c" status: 200 len: 1512 microversion: 2.1 time: 0.155106 Oct 26 11:32:00.167641 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 579/1148] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:32:00 2022] GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:32:00.205942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-b675dad9-b785-44f2-9ae0-bf7c89b41994 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:32:00.214386 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-b675dad9-b785-44f2-9ae0-bf7c89b41994 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1710 microversion: 2.1 time: 0.229299 Oct 26 11:32:00.214994 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 570/1149] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:31:59 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1710 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:32:01.191323 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-7918f75a-9aae-43fe-8313-a1fdc7a0a60d tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:32:01.192598 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-7918f75a-9aae-43fe-8313-a1fdc7a0a60d tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:32:01.201393 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7918f75a-9aae-43fe-8313-a1fdc7a0a60d tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:01.202178 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7918f75a-9aae-43fe-8313-a1fdc7a0a60d tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:01.202779 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7918f75a-9aae-43fe-8313-a1fdc7a0a60d tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:01.204135 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7918f75a-9aae-43fe-8313-a1fdc7a0a60d tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:01.204777 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7918f75a-9aae-43fe-8313-a1fdc7a0a60d tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:01.205433 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7918f75a-9aae-43fe-8313-a1fdc7a0a60d tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:01.239133 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-88b86573-4d5b-40b2-a46d-820fe7b1bc4b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:32:01.240249 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-88b86573-4d5b-40b2-a46d-820fe7b1bc4b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:32:01.263226 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-88b86573-4d5b-40b2-a46d-820fe7b1bc4b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:01.263724 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-88b86573-4d5b-40b2-a46d-820fe7b1bc4b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:01.264163 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-88b86573-4d5b-40b2-a46d-820fe7b1bc4b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:01.264877 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-88b86573-4d5b-40b2-a46d-820fe7b1bc4b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:01.274334 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-88b86573-4d5b-40b2-a46d-820fe7b1bc4b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:01.275005 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-88b86573-4d5b-40b2-a46d-820fe7b1bc4b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:01.484913 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-7918f75a-9aae-43fe-8313-a1fdc7a0a60d tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18665db956ab4da28230c4c2bfe8ffa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044799c63ce94aa39ea143e1633e2002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:32:01.487485 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-7918f75a-9aae-43fe-8313-a1fdc7a0a60d tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c" status: 200 len: 1512 microversion: 2.1 time: 0.300884 Oct 26 11:32:01.488080 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 580/1150] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:32:01 2022] GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c => generated 1512 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:32:01.583230 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-88b86573-4d5b-40b2-a46d-820fe7b1bc4b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:32:01.593398 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-88b86573-4d5b-40b2-a46d-820fe7b1bc4b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1714 microversion: 2.1 time: 0.359247 Oct 26 11:32:01.610671 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 571/1151] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:32:01 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1714 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:32:01.835191 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-bf57c83b-a9cd-420d-91f7-d10ad4721f72 req-df9ca0c2-b8e4-4f5f-9312-aa6f1c7cfbaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c", "name": "network-vif-deleted", "tag": "55c7e502-11c4-4b82-ac60-6790ec30c0a6"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:32:01.844388 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-bf57c83b-a9cd-420d-91f7-d10ad4721f72 req-df9ca0c2-b8e4-4f5f-9312-aa6f1c7cfbaa service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:01.844865 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-bf57c83b-a9cd-420d-91f7-d10ad4721f72 req-df9ca0c2-b8e4-4f5f-9312-aa6f1c7cfbaa service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:01.846917 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-bf57c83b-a9cd-420d-91f7-d10ad4721f72 req-df9ca0c2-b8e4-4f5f-9312-aa6f1c7cfbaa service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:01.857006 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-bf57c83b-a9cd-420d-91f7-d10ad4721f72 req-df9ca0c2-b8e4-4f5f-9312-aa6f1c7cfbaa service nova] Creating event network-vif-deleted:55c7e502-11c4-4b82-ac60-6790ec30c0a6 for instance 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c on hv-cinder-81558 Oct 26 11:32:01.862921 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-bf57c83b-a9cd-420d-91f7-d10ad4721f72 req-df9ca0c2-b8e4-4f5f-9312-aa6f1c7cfbaa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031284 Oct 26 11:32:01.863819 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 581/1152] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:32:02.511607 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-1db7b5e9-4b75-4cc8-b768-927f56055a3b tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:32:02.512206 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-1db7b5e9-4b75-4cc8-b768-927f56055a3b tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:32:02.519864 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1db7b5e9-4b75-4cc8-b768-927f56055a3b tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:02.519864 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1db7b5e9-4b75-4cc8-b768-927f56055a3b tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:02.520250 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1db7b5e9-4b75-4cc8-b768-927f56055a3b tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:02.520697 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1db7b5e9-4b75-4cc8-b768-927f56055a3b tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:02.521146 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1db7b5e9-4b75-4cc8-b768-927f56055a3b tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:02.521835 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1db7b5e9-4b75-4cc8-b768-927f56055a3b tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:02.562589 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1db7b5e9-4b75-4cc8-b768-927f56055a3b tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:02.563120 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1db7b5e9-4b75-4cc8-b768-927f56055a3b tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:02.563570 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-1db7b5e9-4b75-4cc8-b768-927f56055a3b tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:02.564033 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.objects.instance [None req-1db7b5e9-4b75-4cc8-b768-927f56055a3b tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lazy-loading 'fault' on Instance uuid 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c {{(pid=119305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:32:02.616146 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-1db7b5e9-4b75-4cc8-b768-927f56055a3b tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18665db956ab4da28230c4c2bfe8ffa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044799c63ce94aa39ea143e1633e2002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:32:02.624794 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-1db7b5e9-4b75-4cc8-b768-927f56055a3b tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c" status: 200 len: 1308 microversion: 2.1 time: 0.117015 Oct 26 11:32:02.625414 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 572/1153] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:32:02 2022] GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c => generated 1308 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:32:03.648799 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-30138a10-71c0-4d8b-a71b-d7da390b2ca0 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:32:03.649544 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-30138a10-71c0-4d8b-a71b-d7da390b2ca0 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:32:03.656452 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-30138a10-71c0-4d8b-a71b-d7da390b2ca0 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:03.656965 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-30138a10-71c0-4d8b-a71b-d7da390b2ca0 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:03.657368 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-30138a10-71c0-4d8b-a71b-d7da390b2ca0 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:03.658059 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-30138a10-71c0-4d8b-a71b-d7da390b2ca0 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:03.658528 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-30138a10-71c0-4d8b-a71b-d7da390b2ca0 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:03.658966 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-30138a10-71c0-4d8b-a71b-d7da390b2ca0 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:03.672003 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.wsgi [None req-30138a10-71c0-4d8b-a71b-d7da390b2ca0 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] HTTP exception thrown: Instance 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c could not be found. Oct 26 11:32:03.673624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-30138a10-71c0-4d8b-a71b-d7da390b2ca0 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Request method failure captured: Oct 26 11:32:03.673624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: request: GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c HTTP/1.1 Oct 26 11:32:03.673624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept: application/json Oct 26 11:32:03.673624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept-Encoding: identity Oct 26 11:32:03.673624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Connection: close Oct 26 11:32:03.673624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Length: 0 Oct 26 11:32:03.673624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Type: application/json Oct 26 11:32:03.673624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Host: 10.222.0.42 Oct 26 11:32:03.673624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Openstack-System-Scope: None Oct 26 11:32:03.673624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: User-Agent: python-urllib3/1.26.12 Oct 26 11:32:03.673624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Auth-Token: gAAAAABjWRpjgYw-gNnmwBOiBtSYFSuvzVvvLsJ8UulAJYDOY7E7UiAUKMql4xgPO6jbLuwUbMsuMZVpgeka13qkUC8-cPdDqgw2cp4pPkgaR_RzhkyO6Cmbvmr2L1BtWz904MinuTOSxOSfmj0iJFdwL05Pnst01Euf2DSDpbMX-lUgRdD9WCo Oct 26 11:32:03.673624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Id: None Oct 26 11:32:03.673624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Name: None Oct 26 11:32:03.673624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Identity-Status: Confirmed Oct 26 11:32:03.673624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Is-Admin-Project: True Oct 26 11:32:03.673624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Id: default Oct 26 11:32:03.673624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Name: Default Oct 26 11:32:03.673624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Id: 044799c63ce94aa39ea143e1633e2002 Oct 26 11:32:03.673624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1434769596 Oct 26 11:32:03.673624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Role: member,reader Oct 26 11:32:03.673624 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Roles: member,reader Oct 26 11:32:03.675821 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_044799c63ce94aa39ea143e1633e2002", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/044799c63ce94aa39ea143e1633e2002"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/044799c63ce94aa39ea143e1633e2002"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/044799c63ce94aa39ea143e1633e2002"}]}] Oct 26 11:32:03.675821 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant: tempest-VolumesSnapshotTestJSON-1434769596 Oct 26 11:32:03.675821 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Id: 044799c63ce94aa39ea143e1633e2002 Oct 26 11:32:03.675821 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1434769596 Oct 26 11:32:03.675821 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User: tempest-VolumesSnapshotTestJSON-1434769596-project Oct 26 11:32:03.675821 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Id: default Oct 26 11:32:03.675821 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Name: Default Oct 26 11:32:03.675821 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Id: 18665db956ab4da28230c4c2bfe8ffa7 Oct 26 11:32:03.675821 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Name: tempest-VolumesSnapshotTestJSON-1434769596-project Oct 26 11:32:03.675821 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: method: > Oct 26 11:32:03.675821 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: exception: Instance 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c could not be found. Oct 26 11:32:03.675821 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: action_args: {'id': '7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c'} Oct 26 11:32:03.676748 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:32:03.676748 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:32:03.676748 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:32:03.676748 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:32:03.676748 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:32:03.676748 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:32:03.676748 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:32:03.676748 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:32:03.676748 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:32:03.676748 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:32:03.676748 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c could not be found. Oct 26 11:32:03.676748 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:32:03.676748 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:32:03.676748 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:32:03.676748 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:32:03.676748 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:32:03.676748 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:32:03.676748 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:32:03.676748 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:32:03.676748 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:32:03.678329 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:32:03.678329 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 11:32:03.678329 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 11:32:03.678329 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:32:03.678329 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:32:03.678329 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:32:03.678329 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:32:03.678329 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c could not be found. Oct 26 11:32:03.678329 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:32:03.678329 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:32:03.678329 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:32:03.678329 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:32:03.678329 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:32:03.678329 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:32:03.678329 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:32:03.678329 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:32:03.678329 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c could not be found. Oct 26 11:32:03.678329 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:32:03.679784 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-30138a10-71c0-4d8b-a71b-d7da390b2ca0 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Returning 404 to user: Instance 7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c could not be found. {{(pid=119306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:32:03.679784 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-30138a10-71c0-4d8b-a71b-d7da390b2ca0 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c" status: 404 len: 111 microversion: 2.1 time: 0.031093 Oct 26 11:32:03.679784 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 582/1154] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:32:03 2022] GET /compute/v2.1/servers/7bbcfe7d-ad7b-4ce8-97f5-5a9076f3d69c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:32:14.150879 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-8f0f1a66-c25a-456b-99f7-8c5121a86570 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-164220307", "imageRef": "ed8b5733-339c-4fa7-9767-abef514cb9f2", "flavorRef": "452", "networks": [{"uuid": "a6c839a0-5fc6-4351-8012-8fd2ee054dee"}]}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:32:14.160136 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:32:14.160787 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=24 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:32:14.208158 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.network.neutron [None req-8f0f1a66-c25a-456b-99f7-8c5121a86570 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] validate_networks() for [('a6c839a0-5fc6-4351-8012-8fd2ee054dee', None, None, None, None, None)] {{(pid=119305) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 11:32:14.648606 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-8f0f1a66-c25a-456b-99f7-8c5121a86570 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Flavor limits 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 11:32:14.649018 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-8f0f1a66-c25a-456b-99f7-8c5121a86570 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Image limits 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 11:32:14.649481 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-8f0f1a66-c25a-456b-99f7-8c5121a86570 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Flavor pref 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 11:32:14.649881 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-8f0f1a66-c25a-456b-99f7-8c5121a86570 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Image pref 0:0:0 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 11:32:14.650283 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.virt.hardware [None req-8f0f1a66-c25a-456b-99f7-8c5121a86570 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 11:32:14.659406 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8f0f1a66-c25a-456b-99f7-8c5121a86570 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:14.659912 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8f0f1a66-c25a-456b-99f7-8c5121a86570 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:14.660349 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8f0f1a66-c25a-456b-99f7-8c5121a86570 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:14.661081 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8f0f1a66-c25a-456b-99f7-8c5121a86570 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:14.661535 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8f0f1a66-c25a-456b-99f7-8c5121a86570 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:14.661967 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8f0f1a66-c25a-456b-99f7-8c5121a86570 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:14.679522 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.quota [None req-8f0f1a66-c25a-456b-99f7-8c5121a86570 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Getting quotas for project 044799c63ce94aa39ea143e1633e2002. Resources: {'cores', 'instances', 'ram'} {{(pid=119305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:32:14.683464 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.quota [None req-8f0f1a66-c25a-456b-99f7-8c5121a86570 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Getting quotas for user 18665db956ab4da28230c4c2bfe8ffa7 and project 044799c63ce94aa39ea143e1633e2002. Resources: {'cores', 'instances', 'ram'} {{(pid=119305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:32:14.694349 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-8f0f1a66-c25a-456b-99f7-8c5121a86570 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Going to run 1 instances... {{(pid=119305) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 11:32:14.696642 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-8f0f1a66-c25a-456b-99f7-8c5121a86570 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 5d2f70a6-9031-440a-b4c3-efd2c567ed03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed8b5733-339c-4fa7-9767-abef514cb9f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119305) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 11:32:14.856693 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-8f0f1a66-c25a-456b-99f7-8c5121a86570 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.709947 Oct 26 11:32:14.857375 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 573/1155] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Oct 26 11:32:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 11:32:14.868440 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e0c078fc-a0ba-4edc-9f4b-6d360ab84b71 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:32:14.869371 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-e0c078fc-a0ba-4edc-9f4b-6d360ab84b71 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 5d2f70a6-9031-440a-b4c3-efd2c567ed03] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:32:14.872734 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:32:14.873472 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=98 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:32:14.927022 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-e0c078fc-a0ba-4edc-9f4b-6d360ab84b71 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18665db956ab4da28230c4c2bfe8ffa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044799c63ce94aa39ea143e1633e2002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:32:14.934552 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-e0c078fc-a0ba-4edc-9f4b-6d360ab84b71 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03" status: 200 len: 1218 microversion: 2.1 time: 0.069921 Oct 26 11:32:14.935142 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 583/1156] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:32:14 2022] GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:32:15.959792 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-59b097fd-75a0-4ec6-bd2d-66c501dd9703 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:32:15.960420 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-59b097fd-75a0-4ec6-bd2d-66c501dd9703 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 5d2f70a6-9031-440a-b4c3-efd2c567ed03] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:32:15.967286 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-59b097fd-75a0-4ec6-bd2d-66c501dd9703 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:15.967767 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-59b097fd-75a0-4ec6-bd2d-66c501dd9703 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:15.968201 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-59b097fd-75a0-4ec6-bd2d-66c501dd9703 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:15.968900 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-59b097fd-75a0-4ec6-bd2d-66c501dd9703 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:15.969411 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-59b097fd-75a0-4ec6-bd2d-66c501dd9703 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:15.969834 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-59b097fd-75a0-4ec6-bd2d-66c501dd9703 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:16.032821 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-59b097fd-75a0-4ec6-bd2d-66c501dd9703 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18665db956ab4da28230c4c2bfe8ffa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044799c63ce94aa39ea143e1633e2002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:32:16.040573 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-59b097fd-75a0-4ec6-bd2d-66c501dd9703 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03" status: 200 len: 1214 microversion: 2.1 time: 0.086716 Oct 26 11:32:16.041158 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 574/1157] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:32:15 2022] GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:32:17.064146 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-d9b5b8c6-5195-4184-8fc1-f5c257452e43 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:32:17.064760 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-d9b5b8c6-5195-4184-8fc1-f5c257452e43 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 5d2f70a6-9031-440a-b4c3-efd2c567ed03] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:32:17.079868 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d9b5b8c6-5195-4184-8fc1-f5c257452e43 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:17.080358 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d9b5b8c6-5195-4184-8fc1-f5c257452e43 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:17.080796 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d9b5b8c6-5195-4184-8fc1-f5c257452e43 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:17.081500 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d9b5b8c6-5195-4184-8fc1-f5c257452e43 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:17.081958 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d9b5b8c6-5195-4184-8fc1-f5c257452e43 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:17.082382 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d9b5b8c6-5195-4184-8fc1-f5c257452e43 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:17.171374 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-d9b5b8c6-5195-4184-8fc1-f5c257452e43 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18665db956ab4da28230c4c2bfe8ffa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044799c63ce94aa39ea143e1633e2002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:32:17.178940 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-d9b5b8c6-5195-4184-8fc1-f5c257452e43 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03" status: 200 len: 1276 microversion: 2.1 time: 0.119044 Oct 26 11:32:17.179504 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 584/1158] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:32:17 2022] GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03 => generated 1276 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:32:18.202968 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-e53b663f-9116-4b5b-82cf-f6e31e408b0e tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:32:18.203565 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-e53b663f-9116-4b5b-82cf-f6e31e408b0e tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 5d2f70a6-9031-440a-b4c3-efd2c567ed03] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:32:18.209909 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e53b663f-9116-4b5b-82cf-f6e31e408b0e tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:18.210390 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e53b663f-9116-4b5b-82cf-f6e31e408b0e tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:18.210842 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e53b663f-9116-4b5b-82cf-f6e31e408b0e tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:18.211587 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e53b663f-9116-4b5b-82cf-f6e31e408b0e tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:18.212039 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e53b663f-9116-4b5b-82cf-f6e31e408b0e tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:18.212469 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e53b663f-9116-4b5b-82cf-f6e31e408b0e tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:18.348713 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-e53b663f-9116-4b5b-82cf-f6e31e408b0e tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18665db956ab4da28230c4c2bfe8ffa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044799c63ce94aa39ea143e1633e2002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:32:18.356993 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-e53b663f-9116-4b5b-82cf-f6e31e408b0e tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03" status: 200 len: 1318 microversion: 2.1 time: 0.158026 Oct 26 11:32:18.357558 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 575/1159] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:32:18 2022] GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:32:18.499121 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-d98ed58f-fe48-4e66-8b64-c8db206c7b69 req-a4a4eee5-fb2b-44e8-9033-68a6954630db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d2f70a6-9031-440a-b4c3-efd2c567ed03", "tag": "0cef2a0b-e427-498c-8c92-e0bdc51d8cd7"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:32:18.509296 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-d98ed58f-fe48-4e66-8b64-c8db206c7b69 req-a4a4eee5-fb2b-44e8-9033-68a6954630db service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:18.509758 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-d98ed58f-fe48-4e66-8b64-c8db206c7b69 req-a4a4eee5-fb2b-44e8-9033-68a6954630db service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:18.510193 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-d98ed58f-fe48-4e66-8b64-c8db206c7b69 req-a4a4eee5-fb2b-44e8-9033-68a6954630db service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:18.521138 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-d98ed58f-fe48-4e66-8b64-c8db206c7b69 req-a4a4eee5-fb2b-44e8-9033-68a6954630db service nova] Creating event network-changed:0cef2a0b-e427-498c-8c92-e0bdc51d8cd7 for instance 5d2f70a6-9031-440a-b4c3-efd2c567ed03 on hv-cinder-81558 Oct 26 11:32:18.526972 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-d98ed58f-fe48-4e66-8b64-c8db206c7b69 req-a4a4eee5-fb2b-44e8-9033-68a6954630db service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032501 Oct 26 11:32:18.527569 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 585/1160] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:32:19.380466 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-e0bbf100-a5b3-4094-8c24-6b193a23604c tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:32:19.381106 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-e0bbf100-a5b3-4094-8c24-6b193a23604c tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 5d2f70a6-9031-440a-b4c3-efd2c567ed03] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:32:19.388107 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e0bbf100-a5b3-4094-8c24-6b193a23604c tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:19.388591 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e0bbf100-a5b3-4094-8c24-6b193a23604c tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:19.389077 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e0bbf100-a5b3-4094-8c24-6b193a23604c tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:19.389720 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e0bbf100-a5b3-4094-8c24-6b193a23604c tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:19.390175 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e0bbf100-a5b3-4094-8c24-6b193a23604c tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:19.390602 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e0bbf100-a5b3-4094-8c24-6b193a23604c tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:19.516128 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-e0bbf100-a5b3-4094-8c24-6b193a23604c tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18665db956ab4da28230c4c2bfe8ffa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044799c63ce94aa39ea143e1633e2002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:32:19.523670 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-e0bbf100-a5b3-4094-8c24-6b193a23604c tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03" status: 200 len: 1318 microversion: 2.1 time: 0.147089 Oct 26 11:32:19.524239 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 576/1161] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:32:19 2022] GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:32:20.547397 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-90152726-251c-4a5c-9ee9-068507b681b7 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:32:20.548093 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-90152726-251c-4a5c-9ee9-068507b681b7 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 5d2f70a6-9031-440a-b4c3-efd2c567ed03] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:32:20.554921 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-90152726-251c-4a5c-9ee9-068507b681b7 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:20.555399 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-90152726-251c-4a5c-9ee9-068507b681b7 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:20.555828 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-90152726-251c-4a5c-9ee9-068507b681b7 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:20.556504 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-90152726-251c-4a5c-9ee9-068507b681b7 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:20.556949 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-90152726-251c-4a5c-9ee9-068507b681b7 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:20.557365 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-90152726-251c-4a5c-9ee9-068507b681b7 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:20.686835 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-90152726-251c-4a5c-9ee9-068507b681b7 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18665db956ab4da28230c4c2bfe8ffa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044799c63ce94aa39ea143e1633e2002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:32:20.695087 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-90152726-251c-4a5c-9ee9-068507b681b7 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03" status: 200 len: 1318 microversion: 2.1 time: 0.151877 Oct 26 11:32:20.695647 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 586/1162] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:32:20 2022] GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:32:21.718561 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-e7423b44-9fe6-4eed-b1eb-6f780e97148c tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:32:21.719203 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-e7423b44-9fe6-4eed-b1eb-6f780e97148c tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 5d2f70a6-9031-440a-b4c3-efd2c567ed03] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:32:21.726286 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e7423b44-9fe6-4eed-b1eb-6f780e97148c tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:21.726602 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e7423b44-9fe6-4eed-b1eb-6f780e97148c tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:21.727067 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e7423b44-9fe6-4eed-b1eb-6f780e97148c tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:21.727769 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e7423b44-9fe6-4eed-b1eb-6f780e97148c tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:21.728222 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e7423b44-9fe6-4eed-b1eb-6f780e97148c tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:21.728646 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e7423b44-9fe6-4eed-b1eb-6f780e97148c tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:21.858682 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-e7423b44-9fe6-4eed-b1eb-6f780e97148c tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18665db956ab4da28230c4c2bfe8ffa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044799c63ce94aa39ea143e1633e2002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:32:21.867296 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-e7423b44-9fe6-4eed-b1eb-6f780e97148c tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03" status: 200 len: 1318 microversion: 2.1 time: 0.152705 Oct 26 11:32:21.867871 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 577/1163] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:32:21 2022] GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:32:22.890685 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-282dcef9-3b7e-4fca-b9d2-afb935608c84 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:32:22.891328 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-282dcef9-3b7e-4fca-b9d2-afb935608c84 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 5d2f70a6-9031-440a-b4c3-efd2c567ed03] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:32:22.897576 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-282dcef9-3b7e-4fca-b9d2-afb935608c84 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:22.898048 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-282dcef9-3b7e-4fca-b9d2-afb935608c84 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:22.898474 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-282dcef9-3b7e-4fca-b9d2-afb935608c84 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:22.899182 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-282dcef9-3b7e-4fca-b9d2-afb935608c84 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:22.899625 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-282dcef9-3b7e-4fca-b9d2-afb935608c84 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:22.900121 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-282dcef9-3b7e-4fca-b9d2-afb935608c84 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:23.027935 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-282dcef9-3b7e-4fca-b9d2-afb935608c84 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18665db956ab4da28230c4c2bfe8ffa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044799c63ce94aa39ea143e1633e2002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:32:23.035562 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-282dcef9-3b7e-4fca-b9d2-afb935608c84 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03" status: 200 len: 1318 microversion: 2.1 time: 0.148875 Oct 26 11:32:23.036125 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 587/1164] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:32:22 2022] GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:32:23.940158 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-5952aa6f-9f7d-4b77-b9b8-5769bcfc1e5e req-0717c4fb-daf8-4f56-accf-05123463adef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d2f70a6-9031-440a-b4c3-efd2c567ed03", "name": "network-vif-plugged", "status": "completed", "tag": "0cef2a0b-e427-498c-8c92-e0bdc51d8cd7"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:32:23.951263 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-5952aa6f-9f7d-4b77-b9b8-5769bcfc1e5e req-0717c4fb-daf8-4f56-accf-05123463adef service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:23.951737 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-5952aa6f-9f7d-4b77-b9b8-5769bcfc1e5e req-0717c4fb-daf8-4f56-accf-05123463adef service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:23.952167 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-5952aa6f-9f7d-4b77-b9b8-5769bcfc1e5e req-0717c4fb-daf8-4f56-accf-05123463adef service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:23.963108 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-5952aa6f-9f7d-4b77-b9b8-5769bcfc1e5e req-0717c4fb-daf8-4f56-accf-05123463adef service nova] Creating event network-vif-plugged:0cef2a0b-e427-498c-8c92-e0bdc51d8cd7 for instance 5d2f70a6-9031-440a-b4c3-efd2c567ed03 on hv-cinder-81558 Oct 26 11:32:23.968163 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-5952aa6f-9f7d-4b77-b9b8-5769bcfc1e5e req-0717c4fb-daf8-4f56-accf-05123463adef service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032138 Oct 26 11:32:23.968803 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 578/1165] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:32:24.059750 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-b0f92702-ed50-4cc1-b353-96dee01d218f tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:32:24.061016 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-b0f92702-ed50-4cc1-b353-96dee01d218f tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 5d2f70a6-9031-440a-b4c3-efd2c567ed03] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:32:24.068029 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b0f92702-ed50-4cc1-b353-96dee01d218f tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:24.068820 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b0f92702-ed50-4cc1-b353-96dee01d218f tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:24.070008 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b0f92702-ed50-4cc1-b353-96dee01d218f tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:24.070707 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b0f92702-ed50-4cc1-b353-96dee01d218f tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:24.071466 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b0f92702-ed50-4cc1-b353-96dee01d218f tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:24.072184 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-b0f92702-ed50-4cc1-b353-96dee01d218f tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:24.208395 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-b0f92702-ed50-4cc1-b353-96dee01d218f tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18665db956ab4da28230c4c2bfe8ffa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044799c63ce94aa39ea143e1633e2002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:32:24.215979 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-b0f92702-ed50-4cc1-b353-96dee01d218f tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03" status: 200 len: 1318 microversion: 2.1 time: 0.160088 Oct 26 11:32:24.216542 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 588/1166] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:32:24 2022] GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:32:25.236152 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell0:SELECT=2 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:32:25.236948 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell0:SELECT=6 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:32:25.241894 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-9ea1a966-52a3-4f50-aff3-a31bd92650e3 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:32:25.242596 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-9ea1a966-52a3-4f50-aff3-a31bd92650e3 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 5d2f70a6-9031-440a-b4c3-efd2c567ed03] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:32:25.248632 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9ea1a966-52a3-4f50-aff3-a31bd92650e3 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:25.249109 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9ea1a966-52a3-4f50-aff3-a31bd92650e3 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:25.249542 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9ea1a966-52a3-4f50-aff3-a31bd92650e3 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:25.250232 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9ea1a966-52a3-4f50-aff3-a31bd92650e3 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:25.250685 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9ea1a966-52a3-4f50-aff3-a31bd92650e3 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:25.251142 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9ea1a966-52a3-4f50-aff3-a31bd92650e3 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:25.380968 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-9ea1a966-52a3-4f50-aff3-a31bd92650e3 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18665db956ab4da28230c4c2bfe8ffa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044799c63ce94aa39ea143e1633e2002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:32:25.389140 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-9ea1a966-52a3-4f50-aff3-a31bd92650e3 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03" status: 200 len: 1318 microversion: 2.1 time: 0.153968 Oct 26 11:32:25.389701 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 579/1167] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:32:25 2022] GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:32:26.411970 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-3641f533-f5b5-4592-a50d-583cbc6c271e tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:32:26.412608 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-3641f533-f5b5-4592-a50d-583cbc6c271e tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 5d2f70a6-9031-440a-b4c3-efd2c567ed03] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:32:26.415111 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell0:SELECT=2 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:32:26.420304 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3641f533-f5b5-4592-a50d-583cbc6c271e tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:26.420788 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3641f533-f5b5-4592-a50d-583cbc6c271e tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:26.421223 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3641f533-f5b5-4592-a50d-583cbc6c271e tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:26.425099 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3641f533-f5b5-4592-a50d-583cbc6c271e tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:26.425099 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3641f533-f5b5-4592-a50d-583cbc6c271e tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:26.425099 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3641f533-f5b5-4592-a50d-583cbc6c271e tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:26.551352 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-3641f533-f5b5-4592-a50d-583cbc6c271e tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18665db956ab4da28230c4c2bfe8ffa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044799c63ce94aa39ea143e1633e2002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:32:26.559463 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-3641f533-f5b5-4592-a50d-583cbc6c271e tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03" status: 200 len: 1506 microversion: 2.1 time: 0.151347 Oct 26 11:32:26.560036 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 589/1168] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:32:26 2022] GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:32:26.581547 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-62ade5d9-5c9c-4224-b1f0-33eb99335c7e tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26da868c-c28a-4e81-ba19-8a44b39d57ed", "device": "/dev/sdb"}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:32:26.583997 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-62ade5d9-5c9c-4224-b1f0-33eb99335c7e tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 5d2f70a6-9031-440a-b4c3-efd2c567ed03] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:32:26.590276 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-62ade5d9-5c9c-4224-b1f0-33eb99335c7e tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:26.590762 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-62ade5d9-5c9c-4224-b1f0-33eb99335c7e tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:26.591225 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-62ade5d9-5c9c-4224-b1f0-33eb99335c7e tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:26.591913 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-62ade5d9-5c9c-4224-b1f0-33eb99335c7e tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:26.592370 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-62ade5d9-5c9c-4224-b1f0-33eb99335c7e tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:26.592793 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-62ade5d9-5c9c-4224-b1f0-33eb99335c7e tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:27.286138 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-62ade5d9-5c9c-4224-b1f0-33eb99335c7e tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "POST /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.708403 Oct 26 11:32:27.286742 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 580/1169] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Oct 26 11:32:26 2022] POST /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03/os-volume_attachments => generated 194 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:32:50.315725 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-c7bf7ea2-3e01-4d33-a055-f8f1b1c519aa tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:32:50.316244 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-c7bf7ea2-3e01-4d33-a055-f8f1b1c519aa tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 5d2f70a6-9031-440a-b4c3-efd2c567ed03] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:32:50.318119 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=16 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:32:50.318872 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=32 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:32:50.323914 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c7bf7ea2-3e01-4d33-a055-f8f1b1c519aa tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:50.324387 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c7bf7ea2-3e01-4d33-a055-f8f1b1c519aa tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:50.324817 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c7bf7ea2-3e01-4d33-a055-f8f1b1c519aa tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:50.325497 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c7bf7ea2-3e01-4d33-a055-f8f1b1c519aa tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:50.325943 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c7bf7ea2-3e01-4d33-a055-f8f1b1c519aa tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:50.326413 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c7bf7ea2-3e01-4d33-a055-f8f1b1c519aa tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:50.404587 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.objects.instance [None req-c7bf7ea2-3e01-4d33-a055-f8f1b1c519aa tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lazy-loading 'services' on Instance uuid 5d2f70a6-9031-440a-b4c3-efd2c567ed03 {{(pid=119306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:32:50.613090 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-c7bf7ea2-3e01-4d33-a055-f8f1b1c519aa tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03/os-volume_attachments/26da868c-c28a-4e81-ba19-8a44b39d57ed" status: 202 len: 0 microversion: 2.1 time: 0.301219 Oct 26 11:32:50.613868 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 590/1170] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Oct 26 11:32:50 2022] DELETE /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03/os-volume_attachments/26da868c-c28a-4e81-ba19-8a44b39d57ed => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 11:32:51.741655 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:32:51.742500 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:32:51.746981 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a5db1dc5-0cde-4a68-a190-f3aaccf806d0 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:32:51.747200 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-a5db1dc5-0cde-4a68-a190-f3aaccf806d0 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 5d2f70a6-9031-440a-b4c3-efd2c567ed03] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:32:51.753267 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a5db1dc5-0cde-4a68-a190-f3aaccf806d0 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:51.753757 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a5db1dc5-0cde-4a68-a190-f3aaccf806d0 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:51.754181 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a5db1dc5-0cde-4a68-a190-f3aaccf806d0 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:51.754974 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a5db1dc5-0cde-4a68-a190-f3aaccf806d0 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:51.755345 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a5db1dc5-0cde-4a68-a190-f3aaccf806d0 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:51.755767 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a5db1dc5-0cde-4a68-a190-f3aaccf806d0 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:51.784058 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-a5db1dc5-0cde-4a68-a190-f3aaccf806d0 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 5d2f70a6-9031-440a-b4c3-efd2c567ed03] Going to try to terminate instance {{(pid=119305) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 11:32:52.063380 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-a5db1dc5-0cde-4a68-a190-f3aaccf806d0 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03" status: 204 len: 0 microversion: 2.1 time: 0.322920 Oct 26 11:32:52.063898 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 581/1171] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Oct 26 11:32:51 2022] DELETE /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 11:32:52.073210 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-425244ff-7d62-4c65-9f94-86b7aa05a979 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:32:52.073935 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-425244ff-7d62-4c65-9f94-86b7aa05a979 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 5d2f70a6-9031-440a-b4c3-efd2c567ed03] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:32:52.080898 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-425244ff-7d62-4c65-9f94-86b7aa05a979 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:52.081382 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-425244ff-7d62-4c65-9f94-86b7aa05a979 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:52.081816 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-425244ff-7d62-4c65-9f94-86b7aa05a979 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:52.082508 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-425244ff-7d62-4c65-9f94-86b7aa05a979 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:52.082997 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-425244ff-7d62-4c65-9f94-86b7aa05a979 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:52.083420 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-425244ff-7d62-4c65-9f94-86b7aa05a979 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:52.211553 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-425244ff-7d62-4c65-9f94-86b7aa05a979 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18665db956ab4da28230c4c2bfe8ffa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044799c63ce94aa39ea143e1633e2002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:32:52.219302 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-425244ff-7d62-4c65-9f94-86b7aa05a979 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03" status: 200 len: 1512 microversion: 2.1 time: 0.150737 Oct 26 11:32:52.219884 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 591/1172] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:32:52 2022] GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:32:53.243990 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-65c6d02e-8bf2-41b9-bfc2-5f4ec751d824 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:32:53.244608 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-65c6d02e-8bf2-41b9-bfc2-5f4ec751d824 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 5d2f70a6-9031-440a-b4c3-efd2c567ed03] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:32:53.251423 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-65c6d02e-8bf2-41b9-bfc2-5f4ec751d824 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:53.251901 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-65c6d02e-8bf2-41b9-bfc2-5f4ec751d824 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:53.252340 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-65c6d02e-8bf2-41b9-bfc2-5f4ec751d824 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:53.253018 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-65c6d02e-8bf2-41b9-bfc2-5f4ec751d824 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:53.253466 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-65c6d02e-8bf2-41b9-bfc2-5f4ec751d824 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:53.253887 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-65c6d02e-8bf2-41b9-bfc2-5f4ec751d824 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:53.381061 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-65c6d02e-8bf2-41b9-bfc2-5f4ec751d824 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18665db956ab4da28230c4c2bfe8ffa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044799c63ce94aa39ea143e1633e2002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:32:53.389185 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-65c6d02e-8bf2-41b9-bfc2-5f4ec751d824 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03" status: 200 len: 1512 microversion: 2.1 time: 0.150182 Oct 26 11:32:53.389763 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 582/1173] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:32:53 2022] GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:32:54.413174 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e27eb11a-967f-42c2-9772-dd7525ed18be tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:32:54.413969 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-e27eb11a-967f-42c2-9772-dd7525ed18be tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 5d2f70a6-9031-440a-b4c3-efd2c567ed03] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:32:54.420923 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e27eb11a-967f-42c2-9772-dd7525ed18be tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:54.421407 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e27eb11a-967f-42c2-9772-dd7525ed18be tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:54.421836 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e27eb11a-967f-42c2-9772-dd7525ed18be tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:54.422522 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e27eb11a-967f-42c2-9772-dd7525ed18be tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:54.423002 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e27eb11a-967f-42c2-9772-dd7525ed18be tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:54.423425 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e27eb11a-967f-42c2-9772-dd7525ed18be tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:54.624349 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-e27eb11a-967f-42c2-9772-dd7525ed18be tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18665db956ab4da28230c4c2bfe8ffa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044799c63ce94aa39ea143e1633e2002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:32:54.631987 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-e27eb11a-967f-42c2-9772-dd7525ed18be tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03" status: 200 len: 1512 microversion: 2.1 time: 0.222732 Oct 26 11:32:54.632557 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 592/1174] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:32:54 2022] GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03 => generated 1512 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:32:55.072555 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-ad910d52-3975-439f-9339-1f2963965caa req-20dd1e45-e291-4463-b067-268c2a287c9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d2f70a6-9031-440a-b4c3-efd2c567ed03", "name": "network-vif-deleted", "tag": "0cef2a0b-e427-498c-8c92-e0bdc51d8cd7"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:32:55.083105 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-ad910d52-3975-439f-9339-1f2963965caa req-20dd1e45-e291-4463-b067-268c2a287c9d service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:55.084047 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-ad910d52-3975-439f-9339-1f2963965caa req-20dd1e45-e291-4463-b067-268c2a287c9d service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:55.084047 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-ad910d52-3975-439f-9339-1f2963965caa req-20dd1e45-e291-4463-b067-268c2a287c9d service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:55.094843 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-ad910d52-3975-439f-9339-1f2963965caa req-20dd1e45-e291-4463-b067-268c2a287c9d service nova] Creating event network-vif-deleted:0cef2a0b-e427-498c-8c92-e0bdc51d8cd7 for instance 5d2f70a6-9031-440a-b4c3-efd2c567ed03 on hv-cinder-81558 Oct 26 11:32:55.099675 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-ad910d52-3975-439f-9339-1f2963965caa req-20dd1e45-e291-4463-b067-268c2a287c9d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030962 Oct 26 11:32:55.100420 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 583/1175] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:32:55.656124 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-99b77874-41ff-499e-aef4-16bd04e8a066 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:32:55.656731 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-99b77874-41ff-499e-aef4-16bd04e8a066 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 5d2f70a6-9031-440a-b4c3-efd2c567ed03] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:32:55.663019 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-99b77874-41ff-499e-aef4-16bd04e8a066 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:55.663497 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-99b77874-41ff-499e-aef4-16bd04e8a066 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:55.667890 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-99b77874-41ff-499e-aef4-16bd04e8a066 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:55.667890 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-99b77874-41ff-499e-aef4-16bd04e8a066 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:55.667890 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-99b77874-41ff-499e-aef4-16bd04e8a066 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:55.667890 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-99b77874-41ff-499e-aef4-16bd04e8a066 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:55.694964 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-99b77874-41ff-499e-aef4-16bd04e8a066 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:55.695431 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-99b77874-41ff-499e-aef4-16bd04e8a066 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:55.695857 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-99b77874-41ff-499e-aef4-16bd04e8a066 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:55.696290 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.objects.instance [None req-99b77874-41ff-499e-aef4-16bd04e8a066 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lazy-loading 'fault' on Instance uuid 5d2f70a6-9031-440a-b4c3-efd2c567ed03 {{(pid=119306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:32:55.739377 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-99b77874-41ff-499e-aef4-16bd04e8a066 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18665db956ab4da28230c4c2bfe8ffa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044799c63ce94aa39ea143e1633e2002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:32:55.747101 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-99b77874-41ff-499e-aef4-16bd04e8a066 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03" status: 200 len: 1308 microversion: 2.1 time: 0.095670 Oct 26 11:32:55.747753 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 593/1176] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:32:55 2022] GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:32:56.770125 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-9b163496-a139-492d-9f90-f1e0176bff58 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:32:56.770852 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-9b163496-a139-492d-9f90-f1e0176bff58 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] [instance: 5d2f70a6-9031-440a-b4c3-efd2c567ed03] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:32:56.777717 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9b163496-a139-492d-9f90-f1e0176bff58 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:56.778201 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9b163496-a139-492d-9f90-f1e0176bff58 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:56.779203 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9b163496-a139-492d-9f90-f1e0176bff58 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:56.779898 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9b163496-a139-492d-9f90-f1e0176bff58 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:32:56.780352 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9b163496-a139-492d-9f90-f1e0176bff58 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:32:56.780777 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-9b163496-a139-492d-9f90-f1e0176bff58 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:32:56.793646 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.wsgi [None req-9b163496-a139-492d-9f90-f1e0176bff58 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] HTTP exception thrown: Instance 5d2f70a6-9031-440a-b4c3-efd2c567ed03 could not be found. Oct 26 11:32:56.795946 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-9b163496-a139-492d-9f90-f1e0176bff58 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Request method failure captured: Oct 26 11:32:56.795946 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: request: GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03 HTTP/1.1 Oct 26 11:32:56.795946 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept: application/json Oct 26 11:32:56.795946 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept-Encoding: identity Oct 26 11:32:56.795946 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Connection: close Oct 26 11:32:56.795946 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Length: 0 Oct 26 11:32:56.795946 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Type: application/json Oct 26 11:32:56.795946 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Host: 10.222.0.42 Oct 26 11:32:56.795946 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Openstack-System-Scope: None Oct 26 11:32:56.795946 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: User-Agent: python-urllib3/1.26.12 Oct 26 11:32:56.795946 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Auth-Token: gAAAAABjWRpjgYw-gNnmwBOiBtSYFSuvzVvvLsJ8UulAJYDOY7E7UiAUKMql4xgPO6jbLuwUbMsuMZVpgeka13qkUC8-cPdDqgw2cp4pPkgaR_RzhkyO6Cmbvmr2L1BtWz904MinuTOSxOSfmj0iJFdwL05Pnst01Euf2DSDpbMX-lUgRdD9WCo Oct 26 11:32:56.795946 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Id: None Oct 26 11:32:56.795946 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Name: None Oct 26 11:32:56.795946 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Identity-Status: Confirmed Oct 26 11:32:56.795946 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Is-Admin-Project: True Oct 26 11:32:56.795946 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Id: default Oct 26 11:32:56.795946 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Name: Default Oct 26 11:32:56.795946 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Id: 044799c63ce94aa39ea143e1633e2002 Oct 26 11:32:56.795946 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1434769596 Oct 26 11:32:56.795946 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Role: member,reader Oct 26 11:32:56.795946 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Roles: member,reader Oct 26 11:32:56.798244 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_044799c63ce94aa39ea143e1633e2002", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/044799c63ce94aa39ea143e1633e2002"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/044799c63ce94aa39ea143e1633e2002"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/044799c63ce94aa39ea143e1633e2002"}]}] Oct 26 11:32:56.798244 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant: tempest-VolumesSnapshotTestJSON-1434769596 Oct 26 11:32:56.798244 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Id: 044799c63ce94aa39ea143e1633e2002 Oct 26 11:32:56.798244 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1434769596 Oct 26 11:32:56.798244 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User: tempest-VolumesSnapshotTestJSON-1434769596-project Oct 26 11:32:56.798244 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Id: default Oct 26 11:32:56.798244 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Name: Default Oct 26 11:32:56.798244 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Id: 18665db956ab4da28230c4c2bfe8ffa7 Oct 26 11:32:56.798244 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Name: tempest-VolumesSnapshotTestJSON-1434769596-project Oct 26 11:32:56.798244 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: method: > Oct 26 11:32:56.798244 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: exception: Instance 5d2f70a6-9031-440a-b4c3-efd2c567ed03 could not be found. Oct 26 11:32:56.798244 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: action_args: {'id': '5d2f70a6-9031-440a-b4c3-efd2c567ed03'} Oct 26 11:32:56.799288 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:32:56.799288 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:32:56.799288 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:32:56.799288 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:32:56.799288 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:32:56.799288 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:32:56.799288 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:32:56.799288 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:32:56.799288 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:32:56.799288 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:32:56.799288 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d2f70a6-9031-440a-b4c3-efd2c567ed03 could not be found. Oct 26 11:32:56.799288 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:32:56.799288 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:32:56.799288 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:32:56.799288 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:32:56.799288 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:32:56.799288 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:32:56.799288 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:32:56.799288 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:32:56.799288 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:32:56.801075 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:32:56.801075 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 11:32:56.801075 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 11:32:56.801075 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:32:56.801075 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:32:56.801075 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:32:56.801075 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:32:56.801075 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d2f70a6-9031-440a-b4c3-efd2c567ed03 could not be found. Oct 26 11:32:56.801075 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:32:56.801075 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:32:56.801075 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:32:56.801075 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:32:56.801075 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:32:56.801075 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:32:56.801075 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:32:56.801075 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:32:56.801075 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d2f70a6-9031-440a-b4c3-efd2c567ed03 could not be found. Oct 26 11:32:56.801075 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:32:56.802527 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-9b163496-a139-492d-9f90-f1e0176bff58 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] Returning 404 to user: Instance 5d2f70a6-9031-440a-b4c3-efd2c567ed03 could not be found. {{(pid=119305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:32:56.802527 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-9b163496-a139-492d-9f90-f1e0176bff58 tempest-VolumesSnapshotTestJSON-1434769596 tempest-VolumesSnapshotTestJSON-1434769596-project] 10.222.0.42 "GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03" status: 404 len: 111 microversion: 2.1 time: 0.031452 Oct 26 11:32:56.802527 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 584/1177] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:32:56 2022] GET /compute/v2.1/servers/5d2f70a6-9031-440a-b4c3-efd2c567ed03 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:33:18.722770 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-7a30685f-eef2-4dea-8094-4c0ff5253a3c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:33:18.723300 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-7a30685f-eef2-4dea-8094-4c0ff5253a3c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:33:18.725356 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=10 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:33:18.726014 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:33:18.730958 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7a30685f-eef2-4dea-8094-4c0ff5253a3c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:33:18.733988 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7a30685f-eef2-4dea-8094-4c0ff5253a3c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:33:18.733988 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7a30685f-eef2-4dea-8094-4c0ff5253a3c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:33:18.733988 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7a30685f-eef2-4dea-8094-4c0ff5253a3c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:33:18.733988 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7a30685f-eef2-4dea-8094-4c0ff5253a3c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:33:18.734402 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-7a30685f-eef2-4dea-8094-4c0ff5253a3c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:33:18.966328 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.objects.instance [None req-7a30685f-eef2-4dea-8094-4c0ff5253a3c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lazy-loading 'services' on Instance uuid bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 {{(pid=119306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:33:19.377714 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-7a30685f-eef2-4dea-8094-4c0ff5253a3c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3/os-volume_attachments/ccd07e3c-bf3a-4b62-9162-b98476a69151" status: 202 len: 0 microversion: 2.1 time: 0.658870 Oct 26 11:33:19.378321 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 594/1178] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Oct 26 11:33:18 2022] DELETE /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3/os-volume_attachments/ccd07e3c-bf3a-4b62-9162-b98476a69151 => generated 0 bytes in 660 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 11:33:21.561009 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-30e4c9e1-41ce-477b-a86e-5df1288bbaf3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:33:21.563429 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:33:21.564075 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:33:21.568707 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-30e4c9e1-41ce-477b-a86e-5df1288bbaf3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:33:21.569194 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-30e4c9e1-41ce-477b-a86e-5df1288bbaf3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:33:21.569630 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-30e4c9e1-41ce-477b-a86e-5df1288bbaf3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:33:21.591342 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-30e4c9e1-41ce-477b-a86e-5df1288bbaf3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Going to try to stop instance {{(pid=119305) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 26 11:33:21.812252 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-30e4c9e1-41ce-477b-a86e-5df1288bbaf3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "POST /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3/action" status: 202 len: 0 microversion: 2.1 time: 0.254937 Oct 26 11:33:21.812784 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 585/1179] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Oct 26 11:33:21 2022] POST /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 11:33:21.822236 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e6b1fedb-b98e-40c2-bfb3-becc1ec6caab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:33:21.822948 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-e6b1fedb-b98e-40c2-bfb3-becc1ec6caab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:33:21.830047 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e6b1fedb-b98e-40c2-bfb3-becc1ec6caab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:33:21.830047 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e6b1fedb-b98e-40c2-bfb3-becc1ec6caab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:33:21.835736 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e6b1fedb-b98e-40c2-bfb3-becc1ec6caab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:33:21.835736 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e6b1fedb-b98e-40c2-bfb3-becc1ec6caab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:33:21.835736 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e6b1fedb-b98e-40c2-bfb3-becc1ec6caab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:33:21.835736 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e6b1fedb-b98e-40c2-bfb3-becc1ec6caab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:33:21.965301 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-e6b1fedb-b98e-40c2-bfb3-becc1ec6caab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:33:21.974264 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-e6b1fedb-b98e-40c2-bfb3-becc1ec6caab tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1678 microversion: 2.1 time: 0.156635 Oct 26 11:33:21.974881 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 595/1180] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:33:21 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:33:22.998588 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-de5cbf08-eea9-4c92-a1a2-1f91d689a53b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:33:22.999319 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-de5cbf08-eea9-4c92-a1a2-1f91d689a53b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:33:23.006667 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-de5cbf08-eea9-4c92-a1a2-1f91d689a53b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:33:23.007188 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-de5cbf08-eea9-4c92-a1a2-1f91d689a53b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:33:23.007638 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-de5cbf08-eea9-4c92-a1a2-1f91d689a53b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:33:23.008335 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-de5cbf08-eea9-4c92-a1a2-1f91d689a53b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:33:23.008794 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-de5cbf08-eea9-4c92-a1a2-1f91d689a53b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:33:23.009228 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-de5cbf08-eea9-4c92-a1a2-1f91d689a53b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:33:23.192042 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-de5cbf08-eea9-4c92-a1a2-1f91d689a53b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:33:23.199628 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-de5cbf08-eea9-4c92-a1a2-1f91d689a53b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1678 microversion: 2.1 time: 0.205728 Oct 26 11:33:23.202957 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 586/1181] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:33:22 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1678 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:33:24.224168 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-ae1988b1-2260-4684-88e7-864f0fb53c04 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:33:24.224781 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-ae1988b1-2260-4684-88e7-864f0fb53c04 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:33:24.231824 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ae1988b1-2260-4684-88e7-864f0fb53c04 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:33:24.232310 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ae1988b1-2260-4684-88e7-864f0fb53c04 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:33:24.232745 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ae1988b1-2260-4684-88e7-864f0fb53c04 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:33:24.233446 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ae1988b1-2260-4684-88e7-864f0fb53c04 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:33:24.233896 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ae1988b1-2260-4684-88e7-864f0fb53c04 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:33:24.234314 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-ae1988b1-2260-4684-88e7-864f0fb53c04 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:33:24.371447 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-ae1988b1-2260-4684-88e7-864f0fb53c04 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:33:24.379661 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-ae1988b1-2260-4684-88e7-864f0fb53c04 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1678 microversion: 2.1 time: 0.159350 Oct 26 11:33:24.380255 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 596/1182] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:33:24 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:33:25.402889 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-4121d997-96ad-43c3-ad4a-08bc3894e6b7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:33:25.403501 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-4121d997-96ad-43c3-ad4a-08bc3894e6b7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:33:25.405621 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 11:33:25.405769 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Wed Oct 26 11:33:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 (ip 10.222.0.42) !!! Oct 26 11:33:25.412753 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4121d997-96ad-43c3-ad4a-08bc3894e6b7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:33:25.413239 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4121d997-96ad-43c3-ad4a-08bc3894e6b7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:33:25.413677 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4121d997-96ad-43c3-ad4a-08bc3894e6b7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:33:25.414365 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4121d997-96ad-43c3-ad4a-08bc3894e6b7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:33:25.414851 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4121d997-96ad-43c3-ad4a-08bc3894e6b7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:33:25.415265 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-4121d997-96ad-43c3-ad4a-08bc3894e6b7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:33:25.548343 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-4121d997-96ad-43c3-ad4a-08bc3894e6b7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:33:25.555952 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-4121d997-96ad-43c3-ad4a-08bc3894e6b7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1678 microversion: 2.1 time: 0.157222 Oct 26 11:33:25.556702 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 587/1183] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:33:25 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:33:26.578887 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-757597a9-d7b3-4679-8644-a72928d8bcd7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:33:26.580098 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-757597a9-d7b3-4679-8644-a72928d8bcd7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:33:26.586431 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-757597a9-d7b3-4679-8644-a72928d8bcd7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:33:26.586953 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-757597a9-d7b3-4679-8644-a72928d8bcd7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:33:26.587387 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-757597a9-d7b3-4679-8644-a72928d8bcd7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:33:26.588075 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-757597a9-d7b3-4679-8644-a72928d8bcd7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:33:26.588560 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-757597a9-d7b3-4679-8644-a72928d8bcd7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:33:26.588980 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-757597a9-d7b3-4679-8644-a72928d8bcd7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:33:26.716751 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-757597a9-d7b3-4679-8644-a72928d8bcd7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:33:26.724496 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-757597a9-d7b3-4679-8644-a72928d8bcd7 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1678 microversion: 2.1 time: 0.149457 Oct 26 11:33:26.725071 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 597/1184] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:33:26 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:33:27.747732 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-2281d24f-1fde-4963-8023-e7399bb4e4ec tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:33:27.748342 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-2281d24f-1fde-4963-8023-e7399bb4e4ec tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:33:27.754307 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2281d24f-1fde-4963-8023-e7399bb4e4ec tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:33:27.754790 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2281d24f-1fde-4963-8023-e7399bb4e4ec tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:33:27.755256 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2281d24f-1fde-4963-8023-e7399bb4e4ec tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:33:27.755938 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2281d24f-1fde-4963-8023-e7399bb4e4ec tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:33:27.756389 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2281d24f-1fde-4963-8023-e7399bb4e4ec tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:33:27.756809 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2281d24f-1fde-4963-8023-e7399bb4e4ec tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:33:27.882558 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-2281d24f-1fde-4963-8023-e7399bb4e4ec tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:33:27.890440 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-2281d24f-1fde-4963-8023-e7399bb4e4ec tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1678 microversion: 2.1 time: 0.146704 Oct 26 11:33:27.891053 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 588/1185] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:33:27 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:33:28.914610 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-9624196a-563e-4557-89dd-28cab01d1fda tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:33:28.915261 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-9624196a-563e-4557-89dd-28cab01d1fda tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:33:28.921650 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9624196a-563e-4557-89dd-28cab01d1fda tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:33:28.922132 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9624196a-563e-4557-89dd-28cab01d1fda tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:33:28.922560 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9624196a-563e-4557-89dd-28cab01d1fda tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:33:28.923845 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9624196a-563e-4557-89dd-28cab01d1fda tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:33:28.924292 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9624196a-563e-4557-89dd-28cab01d1fda tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:33:28.924711 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9624196a-563e-4557-89dd-28cab01d1fda tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:33:29.047499 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-9624196a-563e-4557-89dd-28cab01d1fda tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:33:29.055675 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-9624196a-563e-4557-89dd-28cab01d1fda tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1678 microversion: 2.1 time: 0.145009 Oct 26 11:33:29.056237 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 598/1186] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:33:28 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1678 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:33:30.078876 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-35ab543c-6590-4d56-be42-9c1f18e263c5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:33:30.079503 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-35ab543c-6590-4d56-be42-9c1f18e263c5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:33:30.086048 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-35ab543c-6590-4d56-be42-9c1f18e263c5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:33:30.086514 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-35ab543c-6590-4d56-be42-9c1f18e263c5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:33:30.086980 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-35ab543c-6590-4d56-be42-9c1f18e263c5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:33:30.087672 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-35ab543c-6590-4d56-be42-9c1f18e263c5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:33:30.088127 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-35ab543c-6590-4d56-be42-9c1f18e263c5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:33:30.088553 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-35ab543c-6590-4d56-be42-9c1f18e263c5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:33:30.216687 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-35ab543c-6590-4d56-be42-9c1f18e263c5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:33:30.224295 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-35ab543c-6590-4d56-be42-9c1f18e263c5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1678 microversion: 2.1 time: 0.149418 Oct 26 11:33:30.224859 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 589/1187] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:33:30 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:33:31.247832 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-cb7d469e-d4dd-4431-8214-1b18de4097ef tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:33:31.248425 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-cb7d469e-d4dd-4431-8214-1b18de4097ef tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:33:31.255244 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-cb7d469e-d4dd-4431-8214-1b18de4097ef tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:33:31.255727 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-cb7d469e-d4dd-4431-8214-1b18de4097ef tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:33:31.256162 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-cb7d469e-d4dd-4431-8214-1b18de4097ef tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:33:31.256849 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-cb7d469e-d4dd-4431-8214-1b18de4097ef tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:33:31.257300 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-cb7d469e-d4dd-4431-8214-1b18de4097ef tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:33:31.257726 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-cb7d469e-d4dd-4431-8214-1b18de4097ef tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:33:31.386368 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-cb7d469e-d4dd-4431-8214-1b18de4097ef tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:33:31.393997 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-cb7d469e-d4dd-4431-8214-1b18de4097ef tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1678 microversion: 2.1 time: 0.150062 Oct 26 11:33:31.394558 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 599/1188] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:33:31 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:33:32.416730 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-26fdee43-a50f-40b9-b2d6-a62a273ae547 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:33:32.417388 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-26fdee43-a50f-40b9-b2d6-a62a273ae547 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:33:32.423750 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-26fdee43-a50f-40b9-b2d6-a62a273ae547 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:33:32.424235 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-26fdee43-a50f-40b9-b2d6-a62a273ae547 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:33:32.424672 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-26fdee43-a50f-40b9-b2d6-a62a273ae547 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:33:32.425364 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-26fdee43-a50f-40b9-b2d6-a62a273ae547 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:33:32.425817 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-26fdee43-a50f-40b9-b2d6-a62a273ae547 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:33:32.426242 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-26fdee43-a50f-40b9-b2d6-a62a273ae547 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:33:32.551081 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-26fdee43-a50f-40b9-b2d6-a62a273ae547 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:33:32.558842 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-26fdee43-a50f-40b9-b2d6-a62a273ae547 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1655 microversion: 2.1 time: 0.146024 Oct 26 11:33:32.559405 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 590/1189] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:33:32 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1655 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:33:32.582108 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-08849b4a-1e55-4e66-a8e6-5d35570f50b5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:33:32.588545 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-08849b4a-1e55-4e66-a8e6-5d35570f50b5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:33:32.589023 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-08849b4a-1e55-4e66-a8e6-5d35570f50b5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:33:32.589447 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-08849b4a-1e55-4e66-a8e6-5d35570f50b5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:33:32.610600 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-08849b4a-1e55-4e66-a8e6-5d35570f50b5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Going to try to start instance {{(pid=119306) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 26 11:33:32.909445 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-08849b4a-1e55-4e66-a8e6-5d35570f50b5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "POST /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3/action" status: 202 len: 0 microversion: 2.1 time: 0.331756 Oct 26 11:33:32.910056 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 600/1190] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Oct 26 11:33:32 2022] POST /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 11:33:32.918066 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-5e09f70c-874a-433d-8f52-d904039e6350 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:33:32.918680 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-5e09f70c-874a-433d-8f52-d904039e6350 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:33:32.925013 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5e09f70c-874a-433d-8f52-d904039e6350 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:33:32.925495 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5e09f70c-874a-433d-8f52-d904039e6350 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:33:32.925934 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5e09f70c-874a-433d-8f52-d904039e6350 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:33:32.926624 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5e09f70c-874a-433d-8f52-d904039e6350 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:33:32.927101 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5e09f70c-874a-433d-8f52-d904039e6350 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:33:32.927524 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5e09f70c-874a-433d-8f52-d904039e6350 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:33:33.054239 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-5e09f70c-874a-433d-8f52-d904039e6350 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:33:33.062158 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-5e09f70c-874a-433d-8f52-d904039e6350 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1664 microversion: 2.1 time: 0.147931 Oct 26 11:33:33.062725 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 591/1191] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:33:32 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1664 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:33:34.087469 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-3f729b65-1380-4b00-91e5-fa0d9a502da3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:33:34.088127 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-3f729b65-1380-4b00-91e5-fa0d9a502da3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:33:34.094221 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3f729b65-1380-4b00-91e5-fa0d9a502da3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:33:34.096840 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3f729b65-1380-4b00-91e5-fa0d9a502da3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:33:34.096840 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3f729b65-1380-4b00-91e5-fa0d9a502da3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:33:34.096840 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3f729b65-1380-4b00-91e5-fa0d9a502da3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:33:34.096840 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3f729b65-1380-4b00-91e5-fa0d9a502da3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:33:34.097258 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3f729b65-1380-4b00-91e5-fa0d9a502da3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:33:34.228190 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-3f729b65-1380-4b00-91e5-fa0d9a502da3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:33:34.236009 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-3f729b65-1380-4b00-91e5-fa0d9a502da3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1664 microversion: 2.1 time: 0.153422 Oct 26 11:33:34.236596 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 601/1192] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:33:34 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1664 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:33:35.259368 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-0b53c9d7-5771-43eb-8ee8-6eee7ef6920f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:33:35.259907 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-0b53c9d7-5771-43eb-8ee8-6eee7ef6920f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:33:35.266125 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0b53c9d7-5771-43eb-8ee8-6eee7ef6920f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:33:35.267118 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0b53c9d7-5771-43eb-8ee8-6eee7ef6920f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:33:35.267552 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0b53c9d7-5771-43eb-8ee8-6eee7ef6920f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:33:35.268229 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0b53c9d7-5771-43eb-8ee8-6eee7ef6920f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:33:35.268674 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0b53c9d7-5771-43eb-8ee8-6eee7ef6920f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:33:35.269092 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-0b53c9d7-5771-43eb-8ee8-6eee7ef6920f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:33:35.397495 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-0b53c9d7-5771-43eb-8ee8-6eee7ef6920f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:33:35.405516 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-0b53c9d7-5771-43eb-8ee8-6eee7ef6920f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1668 microversion: 2.1 time: 0.150150 Oct 26 11:33:35.406087 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 592/1193] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:33:35 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1668 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:34:24.354399 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-96aa4dac-90c0-47a5-979f-09a3df7b369c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:34:24.356786 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-96aa4dac-90c0-47a5-979f-09a3df7b369c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:34:24.359297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=16 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:34:24.359949 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:34:24.364650 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-96aa4dac-90c0-47a5-979f-09a3df7b369c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:24.365139 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-96aa4dac-90c0-47a5-979f-09a3df7b369c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:24.365572 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-96aa4dac-90c0-47a5-979f-09a3df7b369c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:24.366258 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-96aa4dac-90c0-47a5-979f-09a3df7b369c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:24.366711 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-96aa4dac-90c0-47a5-979f-09a3df7b369c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:24.367160 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-96aa4dac-90c0-47a5-979f-09a3df7b369c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:24.396157 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-96aa4dac-90c0-47a5-979f-09a3df7b369c tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045631 Oct 26 11:34:24.396710 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 602/1194] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Oct 26 11:34:24 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 11:34:24.464465 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-2eb97a32-c35d-4a3a-bc38-cd60e63a97b5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:34:24.465047 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-2eb97a32-c35d-4a3a-bc38-cd60e63a97b5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:34:24.467451 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_api:SELECT=16 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:34:24.468148 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:34:24.472767 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2eb97a32-c35d-4a3a-bc38-cd60e63a97b5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:24.473250 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2eb97a32-c35d-4a3a-bc38-cd60e63a97b5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:24.473689 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2eb97a32-c35d-4a3a-bc38-cd60e63a97b5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:24.474414 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2eb97a32-c35d-4a3a-bc38-cd60e63a97b5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:24.474895 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2eb97a32-c35d-4a3a-bc38-cd60e63a97b5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:24.475325 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-2eb97a32-c35d-4a3a-bc38-cd60e63a97b5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:24.500648 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-2eb97a32-c35d-4a3a-bc38-cd60e63a97b5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Going to try to terminate instance {{(pid=119305) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 11:34:24.792024 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-2eb97a32-c35d-4a3a-bc38-cd60e63a97b5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 204 len: 0 microversion: 2.1 time: 0.331537 Oct 26 11:34:24.792710 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 593/1195] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Oct 26 11:34:24 2022] DELETE /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 11:34:24.801784 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-8ccfdcf3-c6df-44dd-b7ff-a907a3e17bfd tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:34:24.802398 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-8ccfdcf3-c6df-44dd-b7ff-a907a3e17bfd tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:34:24.809104 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8ccfdcf3-c6df-44dd-b7ff-a907a3e17bfd tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:24.809584 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8ccfdcf3-c6df-44dd-b7ff-a907a3e17bfd tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:24.810014 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8ccfdcf3-c6df-44dd-b7ff-a907a3e17bfd tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:24.810700 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8ccfdcf3-c6df-44dd-b7ff-a907a3e17bfd tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:24.811174 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8ccfdcf3-c6df-44dd-b7ff-a907a3e17bfd tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:24.811670 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8ccfdcf3-c6df-44dd-b7ff-a907a3e17bfd tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:24.941621 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-8ccfdcf3-c6df-44dd-b7ff-a907a3e17bfd tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:34:24.949197 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-8ccfdcf3-c6df-44dd-b7ff-a907a3e17bfd tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1674 microversion: 2.1 time: 0.151887 Oct 26 11:34:24.949770 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 603/1196] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:34:24 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:34:25.973003 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-5c134f8b-2d43-45db-9758-08a484cc8553 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:34:25.973731 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-5c134f8b-2d43-45db-9758-08a484cc8553 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:34:25.980100 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5c134f8b-2d43-45db-9758-08a484cc8553 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:25.980576 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5c134f8b-2d43-45db-9758-08a484cc8553 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:25.981008 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5c134f8b-2d43-45db-9758-08a484cc8553 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:25.981961 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5c134f8b-2d43-45db-9758-08a484cc8553 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:25.982413 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5c134f8b-2d43-45db-9758-08a484cc8553 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:25.982846 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5c134f8b-2d43-45db-9758-08a484cc8553 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:26.111324 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-5c134f8b-2d43-45db-9758-08a484cc8553 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:34:26.118845 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-5c134f8b-2d43-45db-9758-08a484cc8553 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1674 microversion: 2.1 time: 0.150137 Oct 26 11:34:26.119408 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 594/1197] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:34:25 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:34:27.141711 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-35294e16-1d99-46dc-9607-734c2ddcc887 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:34:27.142385 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-35294e16-1d99-46dc-9607-734c2ddcc887 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:34:27.148831 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-35294e16-1d99-46dc-9607-734c2ddcc887 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:27.149311 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-35294e16-1d99-46dc-9607-734c2ddcc887 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:27.149742 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-35294e16-1d99-46dc-9607-734c2ddcc887 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:27.150424 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-35294e16-1d99-46dc-9607-734c2ddcc887 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:27.150900 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-35294e16-1d99-46dc-9607-734c2ddcc887 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:27.151330 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-35294e16-1d99-46dc-9607-734c2ddcc887 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:27.343803 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-35294e16-1d99-46dc-9607-734c2ddcc887 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:34:27.351965 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-35294e16-1d99-46dc-9607-734c2ddcc887 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1674 microversion: 2.1 time: 0.214144 Oct 26 11:34:27.352543 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 604/1198] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:34:27 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1674 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:34:28.140465 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-154faf94-de13-4249-b921-9f0ef530cdcb req-cfef242b-9c61-4844-9b3a-c23f3e94542a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3", "name": "network-vif-deleted", "tag": "569a0fe4-a190-486a-8d3b-deed1812804c"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:34:28.151054 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-154faf94-de13-4249-b921-9f0ef530cdcb req-cfef242b-9c61-4844-9b3a-c23f3e94542a service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:28.156660 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-154faf94-de13-4249-b921-9f0ef530cdcb req-cfef242b-9c61-4844-9b3a-c23f3e94542a service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:28.156660 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-154faf94-de13-4249-b921-9f0ef530cdcb req-cfef242b-9c61-4844-9b3a-c23f3e94542a service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:28.163677 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-154faf94-de13-4249-b921-9f0ef530cdcb req-cfef242b-9c61-4844-9b3a-c23f3e94542a service nova] Creating event network-vif-deleted:569a0fe4-a190-486a-8d3b-deed1812804c for instance bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 on hv-cinder-81558 Oct 26 11:34:28.168557 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-154faf94-de13-4249-b921-9f0ef530cdcb req-cfef242b-9c61-4844-9b3a-c23f3e94542a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031893 Oct 26 11:34:28.169321 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 595/1199] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:34:28.613127 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-d999ccdd-1c96-46cb-86f1-5cb784c6452d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:34:28.614032 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-d999ccdd-1c96-46cb-86f1-5cb784c6452d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:34:28.620866 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d999ccdd-1c96-46cb-86f1-5cb784c6452d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:28.621424 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d999ccdd-1c96-46cb-86f1-5cb784c6452d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:28.622095 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d999ccdd-1c96-46cb-86f1-5cb784c6452d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:28.622794 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d999ccdd-1c96-46cb-86f1-5cb784c6452d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:28.623264 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d999ccdd-1c96-46cb-86f1-5cb784c6452d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:28.623832 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d999ccdd-1c96-46cb-86f1-5cb784c6452d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:28.655651 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d999ccdd-1c96-46cb-86f1-5cb784c6452d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:28.656132 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d999ccdd-1c96-46cb-86f1-5cb784c6452d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:28.656600 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-d999ccdd-1c96-46cb-86f1-5cb784c6452d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:28.657034 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.objects.instance [None req-d999ccdd-1c96-46cb-86f1-5cb784c6452d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lazy-loading 'fault' on Instance uuid bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 {{(pid=119306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:34:28.698786 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-d999ccdd-1c96-46cb-86f1-5cb784c6452d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:34:28.706343 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-d999ccdd-1c96-46cb-86f1-5cb784c6452d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 200 len: 1327 microversion: 2.1 time: 0.334471 Oct 26 11:34:28.706929 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 605/1200] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:34:28 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 1327 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:34:29.730302 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-91d74ed2-3fe2-434f-aa86-4ea057373b1f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:34:29.731036 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-91d74ed2-3fe2-434f-aa86-4ea057373b1f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:34:29.737195 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-91d74ed2-3fe2-434f-aa86-4ea057373b1f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:29.737685 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-91d74ed2-3fe2-434f-aa86-4ea057373b1f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:29.738123 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-91d74ed2-3fe2-434f-aa86-4ea057373b1f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:29.738831 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-91d74ed2-3fe2-434f-aa86-4ea057373b1f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:29.739289 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-91d74ed2-3fe2-434f-aa86-4ea057373b1f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:29.739718 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-91d74ed2-3fe2-434f-aa86-4ea057373b1f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:29.753383 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.wsgi [None req-91d74ed2-3fe2-434f-aa86-4ea057373b1f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] HTTP exception thrown: Instance bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 could not be found. Oct 26 11:34:29.755086 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-91d74ed2-3fe2-434f-aa86-4ea057373b1f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Request method failure captured: Oct 26 11:34:29.755086 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: request: GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 HTTP/1.1 Oct 26 11:34:29.755086 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept: application/json Oct 26 11:34:29.755086 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept-Encoding: identity Oct 26 11:34:29.755086 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Connection: close Oct 26 11:34:29.755086 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Length: 0 Oct 26 11:34:29.755086 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Type: application/json Oct 26 11:34:29.755086 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Host: 10.222.0.42 Oct 26 11:34:29.755086 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Openstack-System-Scope: None Oct 26 11:34:29.755086 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: User-Agent: python-urllib3/1.26.12 Oct 26 11:34:29.755086 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Auth-Token: gAAAAABjWRoWOVoEZSDq11o_WPUxBfBH5X1Tn0zByJ9tNdUyQnICBOpyLC5fja5T9eXSP4eNgIe-5a9uZ3V9VSOWodiW2qNxAqGTJl8udvJCT-0n8YZSK3WDSE2tnBNa9VavTFyxaQA9Gu7NcgrVm_xLJhjxds376v0Q-RhGOUhTfbEV8PcseGQ Oct 26 11:34:29.755086 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Id: None Oct 26 11:34:29.755086 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Name: None Oct 26 11:34:29.755086 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Identity-Status: Confirmed Oct 26 11:34:29.755086 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Is-Admin-Project: True Oct 26 11:34:29.755086 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Id: default Oct 26 11:34:29.755086 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Name: Default Oct 26 11:34:29.755086 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Id: b78491741fc7450b932b7a43e5d3bb92 Oct 26 11:34:29.755086 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Name: tempest-AttachVolumeTestJSON-554587477 Oct 26 11:34:29.755086 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Role: member,reader Oct 26 11:34:29.755086 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Roles: member,reader Oct 26 11:34:29.757511 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b78491741fc7450b932b7a43e5d3bb92", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b78491741fc7450b932b7a43e5d3bb92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b78491741fc7450b932b7a43e5d3bb92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b78491741fc7450b932b7a43e5d3bb92"}]}] Oct 26 11:34:29.757511 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant: tempest-AttachVolumeTestJSON-554587477 Oct 26 11:34:29.757511 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Id: b78491741fc7450b932b7a43e5d3bb92 Oct 26 11:34:29.757511 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Name: tempest-AttachVolumeTestJSON-554587477 Oct 26 11:34:29.757511 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User: tempest-AttachVolumeTestJSON-554587477-project Oct 26 11:34:29.757511 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Id: default Oct 26 11:34:29.757511 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Name: Default Oct 26 11:34:29.757511 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Id: 80087d6fbe284b02b20c64ce3237d3b5 Oct 26 11:34:29.757511 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Name: tempest-AttachVolumeTestJSON-554587477-project Oct 26 11:34:29.757511 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: method: > Oct 26 11:34:29.757511 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: exception: Instance bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 could not be found. Oct 26 11:34:29.757511 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: action_args: {'id': 'bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3'} Oct 26 11:34:29.758560 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:34:29.758560 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:34:29.758560 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:34:29.758560 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:34:29.758560 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:34:29.758560 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:34:29.758560 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:34:29.758560 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:34:29.758560 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:34:29.758560 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:34:29.758560 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 could not be found. Oct 26 11:34:29.758560 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:34:29.758560 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:34:29.758560 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:34:29.758560 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:34:29.758560 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:34:29.758560 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:34:29.758560 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:34:29.758560 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:34:29.758560 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:34:29.760298 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:34:29.760298 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 11:34:29.760298 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 11:34:29.760298 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:34:29.760298 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:34:29.760298 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:34:29.760298 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:34:29.760298 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 could not be found. Oct 26 11:34:29.760298 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:34:29.760298 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:34:29.760298 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:34:29.760298 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:34:29.760298 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:34:29.760298 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:34:29.760298 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:34:29.760298 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:34:29.760298 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 could not be found. Oct 26 11:34:29.760298 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:34:29.761771 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-91d74ed2-3fe2-434f-aa86-4ea057373b1f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Returning 404 to user: Instance bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 could not be found. {{(pid=119305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:34:29.761771 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-91d74ed2-3fe2-434f-aa86-4ea057373b1f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 404 len: 111 microversion: 2.1 time: 0.030909 Oct 26 11:34:29.761771 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 596/1201] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:34:29 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:34:29.766085 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-7dd4f42c-ae31-4889-a519-5e7c1b458649 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '.version_select at 0x7f6b93691d30>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:34:29.770698 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7dd4f42c-ae31-4889-a519-5e7c1b458649 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [53f07c66-ec8f-4976-9235-757ef890b38d] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 26 11:34:30.781039 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO oslo.messaging._drivers.impl_rabbit [None req-7dd4f42c-ae31-4889-a519-5e7c1b458649 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [53f07c66-ec8f-4976-9235-757ef890b38d] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 38492. Oct 26 11:34:30.878006 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-7dd4f42c-ae31-4889-a519-5e7c1b458649 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-415842504" status: 202 len: 0 microversion: 2.1 time: 1.115697 Oct 26 11:34:30.878598 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 606/1202] 10.222.0.42 () {58 vars in 1218 bytes} [Wed Oct 26 11:34:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-415842504 => generated 0 bytes in 1117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 11:34:31.634391 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-04f832ae-7138-4143-a14b-43dd74ba28ce tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Action: 'create', calling method: .version_select at 0x7f6b937f4160>, body: {"keypair": {"name": "tempest-keypair-788185745", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDs5Pse7PeiolBSYl+fct8oEpvmzhn7eJRDZvExCdsh3zC+mFS5+1acrsN6NPVjZqBguVTtah+LUC9Gxa3epB7rXRxdz9wgULyOQWPzr6sXC2nT9w7RxBWd3Uv2V+aA97A=="}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:34:31.649997 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.quota [None req-04f832ae-7138-4143-a14b-43dd74ba28ce tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Getting quotas for project b78491741fc7450b932b7a43e5d3bb92. Resources: {'key_pairs'} {{(pid=119305) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:34:31.654021 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.quota [None req-04f832ae-7138-4143-a14b-43dd74ba28ce tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Getting quotas for user 80087d6fbe284b02b20c64ce3237d3b5 and project b78491741fc7450b932b7a43e5d3bb92. Resources: {'key_pairs'} {{(pid=119305) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:34:31.743794 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-04f832ae-7138-4143-a14b-43dd74ba28ce tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.113273 Oct 26 11:34:31.744402 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 597/1203] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Oct 26 11:34:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:34:33.925184 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-76dbb487-2d18-4d37-9a77-a89293299563 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1543701299", "imageRef": "ed8b5733-339c-4fa7-9767-abef514cb9f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "75737873-3b56-4732-b134-9315e0673dae"}], "security_groups": [{"name": "tempest-securitygroup--1547917646"}], "key_name": "tempest-keypair-788185745", "user_data": "}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:34:34.028606 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.network.neutron [None req-76dbb487-2d18-4d37-9a77-a89293299563 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] validate_networks() for [('75737873-3b56-4732-b134-9315e0673dae', None, None, None, None, None)] {{(pid=119306) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 26 11:34:34.474487 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-76dbb487-2d18-4d37-9a77-a89293299563 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Flavor limits 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 26 11:34:34.475190 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-76dbb487-2d18-4d37-9a77-a89293299563 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Image limits 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 26 11:34:34.476184 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-76dbb487-2d18-4d37-9a77-a89293299563 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Flavor pref 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 26 11:34:34.476596 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-76dbb487-2d18-4d37-9a77-a89293299563 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Image pref 0:0:0 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 26 11:34:34.477009 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.virt.hardware [None req-76dbb487-2d18-4d37-9a77-a89293299563 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119306) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 26 11:34:34.485800 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-76dbb487-2d18-4d37-9a77-a89293299563 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:34.486280 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-76dbb487-2d18-4d37-9a77-a89293299563 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:34.486711 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-76dbb487-2d18-4d37-9a77-a89293299563 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:34.487463 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-76dbb487-2d18-4d37-9a77-a89293299563 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:34.487916 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-76dbb487-2d18-4d37-9a77-a89293299563 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:34.488334 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-76dbb487-2d18-4d37-9a77-a89293299563 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:34.505746 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-76dbb487-2d18-4d37-9a77-a89293299563 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Getting quotas for project b78491741fc7450b932b7a43e5d3bb92. Resources: {'cores', 'instances', 'ram'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 26 11:34:34.509656 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.quota [None req-76dbb487-2d18-4d37-9a77-a89293299563 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Getting quotas for user 80087d6fbe284b02b20c64ce3237d3b5 and project b78491741fc7450b932b7a43e5d3bb92. Resources: {'cores', 'instances', 'ram'} {{(pid=119306) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 26 11:34:34.520483 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-76dbb487-2d18-4d37-9a77-a89293299563 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Going to run 1 instances... {{(pid=119306) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 26 11:34:34.523285 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-76dbb487-2d18-4d37-9a77-a89293299563 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed8b5733-339c-4fa7-9767-abef514cb9f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119306) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 26 11:34:34.651250 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-76dbb487-2d18-4d37-9a77-a89293299563 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.730801 Oct 26 11:34:34.651824 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 607/1204] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Oct 26 11:34:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 26 11:34:34.663871 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-951e2aae-e1e8-4f71-8902-cd5e836944e3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:34:34.664547 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-951e2aae-e1e8-4f71-8902-cd5e836944e3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:34:34.718063 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-951e2aae-e1e8-4f71-8902-cd5e836944e3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:34:34.724961 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-951e2aae-e1e8-4f71-8902-cd5e836944e3 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44" status: 200 len: 1237 microversion: 2.1 time: 0.065671 Oct 26 11:34:34.730682 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 598/1205] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:34:34 2022] GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44 => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:34:35.748936 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-6b892aa7-4f1f-44b6-890b-115bc7a6dc65 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:34:35.749550 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-6b892aa7-4f1f-44b6-890b-115bc7a6dc65 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:34:35.755756 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6b892aa7-4f1f-44b6-890b-115bc7a6dc65 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:35.756246 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6b892aa7-4f1f-44b6-890b-115bc7a6dc65 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:35.756712 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6b892aa7-4f1f-44b6-890b-115bc7a6dc65 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:35.757403 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6b892aa7-4f1f-44b6-890b-115bc7a6dc65 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:35.758024 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6b892aa7-4f1f-44b6-890b-115bc7a6dc65 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:35.758447 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6b892aa7-4f1f-44b6-890b-115bc7a6dc65 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:35.823992 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-6b892aa7-4f1f-44b6-890b-115bc7a6dc65 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:34:35.831654 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-6b892aa7-4f1f-44b6-890b-115bc7a6dc65 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44" status: 200 len: 1241 microversion: 2.1 time: 0.087145 Oct 26 11:34:35.832242 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 608/1206] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:34:35 2022] GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44 => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:34:36.855510 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a106a155-2004-4c85-819c-019751376009 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:34:36.856121 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-a106a155-2004-4c85-819c-019751376009 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:34:36.862361 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a106a155-2004-4c85-819c-019751376009 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:36.862860 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a106a155-2004-4c85-819c-019751376009 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:36.863296 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a106a155-2004-4c85-819c-019751376009 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:36.864013 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a106a155-2004-4c85-819c-019751376009 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:36.864463 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a106a155-2004-4c85-819c-019751376009 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:36.864889 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a106a155-2004-4c85-819c-019751376009 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:36.927469 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-a106a155-2004-4c85-819c-019751376009 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:34:36.935687 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-a106a155-2004-4c85-819c-019751376009 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44" status: 200 len: 1297 microversion: 2.1 time: 0.084188 Oct 26 11:34:36.936602 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 599/1207] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:34:36 2022] GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44 => generated 1297 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:34:37.959350 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-06f20f8b-399e-471c-acac-1fd059db975e tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:34:37.960005 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-06f20f8b-399e-471c-acac-1fd059db975e tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:34:37.966681 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-06f20f8b-399e-471c-acac-1fd059db975e tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:37.967196 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-06f20f8b-399e-471c-acac-1fd059db975e tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:37.967662 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-06f20f8b-399e-471c-acac-1fd059db975e tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:37.968361 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-06f20f8b-399e-471c-acac-1fd059db975e tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:37.968818 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-06f20f8b-399e-471c-acac-1fd059db975e tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:37.969320 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-06f20f8b-399e-471c-acac-1fd059db975e tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:38.172284 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-06f20f8b-399e-471c-acac-1fd059db975e tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:34:38.180183 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-06f20f8b-399e-471c-acac-1fd059db975e tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44" status: 200 len: 1363 microversion: 2.1 time: 0.224758 Oct 26 11:34:38.180765 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 609/1208] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:34:37 2022] GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:34:38.661063 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-282ef72a-64f0-4a50-bc63-02af309099bc req-27ce9cac-6263-47f5-b25f-25250d5fb426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1c26fc3-f012-462e-baa2-fff8a703ff44", "tag": "137ec87e-f49b-46aa-8876-ff1784d2c47c"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:34:38.671302 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-282ef72a-64f0-4a50-bc63-02af309099bc req-27ce9cac-6263-47f5-b25f-25250d5fb426 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:38.671783 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-282ef72a-64f0-4a50-bc63-02af309099bc req-27ce9cac-6263-47f5-b25f-25250d5fb426 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:38.672214 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-282ef72a-64f0-4a50-bc63-02af309099bc req-27ce9cac-6263-47f5-b25f-25250d5fb426 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:38.683147 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-282ef72a-64f0-4a50-bc63-02af309099bc req-27ce9cac-6263-47f5-b25f-25250d5fb426 service nova] Creating event network-changed:137ec87e-f49b-46aa-8876-ff1784d2c47c for instance c1c26fc3-f012-462e-baa2-fff8a703ff44 on hv-cinder-81558 Oct 26 11:34:38.688148 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-282ef72a-64f0-4a50-bc63-02af309099bc req-27ce9cac-6263-47f5-b25f-25250d5fb426 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030861 Oct 26 11:34:38.688888 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 600/1209] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:34:39.203478 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-77361ac8-7002-4281-b97b-e151269109ac tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:34:39.204093 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-77361ac8-7002-4281-b97b-e151269109ac tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:34:39.210479 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-77361ac8-7002-4281-b97b-e151269109ac tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:39.210997 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-77361ac8-7002-4281-b97b-e151269109ac tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:39.211432 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-77361ac8-7002-4281-b97b-e151269109ac tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:39.212113 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-77361ac8-7002-4281-b97b-e151269109ac tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:39.212655 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-77361ac8-7002-4281-b97b-e151269109ac tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:39.212959 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-77361ac8-7002-4281-b97b-e151269109ac tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:39.406009 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-77361ac8-7002-4281-b97b-e151269109ac tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:34:39.414242 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-77361ac8-7002-4281-b97b-e151269109ac tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44" status: 200 len: 1363 microversion: 2.1 time: 0.214651 Oct 26 11:34:39.414829 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 610/1210] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:34:39 2022] GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44 => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 26 11:34:40.438473 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-e0d9a973-32a2-4ca6-8a60-df43f4c50917 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:34:40.439195 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-e0d9a973-32a2-4ca6-8a60-df43f4c50917 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:34:40.445831 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e0d9a973-32a2-4ca6-8a60-df43f4c50917 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:40.446325 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e0d9a973-32a2-4ca6-8a60-df43f4c50917 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:40.446754 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e0d9a973-32a2-4ca6-8a60-df43f4c50917 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:40.447469 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e0d9a973-32a2-4ca6-8a60-df43f4c50917 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:40.447923 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e0d9a973-32a2-4ca6-8a60-df43f4c50917 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:40.448378 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-e0d9a973-32a2-4ca6-8a60-df43f4c50917 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:40.573588 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-e0d9a973-32a2-4ca6-8a60-df43f4c50917 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:34:40.581104 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-e0d9a973-32a2-4ca6-8a60-df43f4c50917 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44" status: 200 len: 1363 microversion: 2.1 time: 0.147362 Oct 26 11:34:40.581670 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 601/1211] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:34:40 2022] GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:34:41.604303 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-1ec2142a-3114-4e84-acd2-ee793b000572 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:34:41.604913 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-1ec2142a-3114-4e84-acd2-ee793b000572 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:34:41.611286 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1ec2142a-3114-4e84-acd2-ee793b000572 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:41.611769 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1ec2142a-3114-4e84-acd2-ee793b000572 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:41.612205 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1ec2142a-3114-4e84-acd2-ee793b000572 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:41.612890 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1ec2142a-3114-4e84-acd2-ee793b000572 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:41.613351 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1ec2142a-3114-4e84-acd2-ee793b000572 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:41.613774 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-1ec2142a-3114-4e84-acd2-ee793b000572 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:41.743691 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-1ec2142a-3114-4e84-acd2-ee793b000572 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:34:41.751578 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-1ec2142a-3114-4e84-acd2-ee793b000572 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44" status: 200 len: 1363 microversion: 2.1 time: 0.151092 Oct 26 11:34:41.754989 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 611/1212] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:34:41 2022] GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:34:42.774046 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-68f5cb6b-1356-4dea-a276-28b3fa55e425 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:34:42.774661 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-68f5cb6b-1356-4dea-a276-28b3fa55e425 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:34:42.781445 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-68f5cb6b-1356-4dea-a276-28b3fa55e425 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:42.781929 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-68f5cb6b-1356-4dea-a276-28b3fa55e425 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:42.782364 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-68f5cb6b-1356-4dea-a276-28b3fa55e425 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:42.783088 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-68f5cb6b-1356-4dea-a276-28b3fa55e425 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:42.783544 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-68f5cb6b-1356-4dea-a276-28b3fa55e425 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:42.783971 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-68f5cb6b-1356-4dea-a276-28b3fa55e425 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:42.915323 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-68f5cb6b-1356-4dea-a276-28b3fa55e425 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:34:42.922966 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-68f5cb6b-1356-4dea-a276-28b3fa55e425 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44" status: 200 len: 1363 microversion: 2.1 time: 0.152820 Oct 26 11:34:42.923537 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 602/1213] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:34:42 2022] GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:34:43.945871 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-f2b6fa09-6c0a-4940-8f5d-a563439faf93 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:34:43.946484 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-f2b6fa09-6c0a-4940-8f5d-a563439faf93 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:34:43.952850 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f2b6fa09-6c0a-4940-8f5d-a563439faf93 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:43.953417 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f2b6fa09-6c0a-4940-8f5d-a563439faf93 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:43.953854 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f2b6fa09-6c0a-4940-8f5d-a563439faf93 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:43.954542 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f2b6fa09-6c0a-4940-8f5d-a563439faf93 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:43.955026 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f2b6fa09-6c0a-4940-8f5d-a563439faf93 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:43.955453 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f2b6fa09-6c0a-4940-8f5d-a563439faf93 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:44.081025 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-f2b6fa09-6c0a-4940-8f5d-a563439faf93 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:34:44.088614 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-f2b6fa09-6c0a-4940-8f5d-a563439faf93 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44" status: 200 len: 1363 microversion: 2.1 time: 0.147117 Oct 26 11:34:44.089199 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 612/1214] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:34:43 2022] GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:34:45.111793 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-6a84950d-0ebf-4c38-abf0-f0020901f537 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:34:45.112407 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-6a84950d-0ebf-4c38-abf0-f0020901f537 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:34:45.114850 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell0:SELECT=6 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:34:45.119646 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6a84950d-0ebf-4c38-abf0-f0020901f537 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:45.120130 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6a84950d-0ebf-4c38-abf0-f0020901f537 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:45.120602 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6a84950d-0ebf-4c38-abf0-f0020901f537 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:45.121339 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6a84950d-0ebf-4c38-abf0-f0020901f537 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:45.121790 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6a84950d-0ebf-4c38-abf0-f0020901f537 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:45.122211 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6a84950d-0ebf-4c38-abf0-f0020901f537 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:45.251618 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-6a84950d-0ebf-4c38-abf0-f0020901f537 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:34:45.259577 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-6a84950d-0ebf-4c38-abf0-f0020901f537 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44" status: 200 len: 1363 microversion: 2.1 time: 0.151649 Oct 26 11:34:45.260139 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 603/1215] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:34:45 2022] GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:34:46.282790 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-98070792-bde1-49ec-997d-e8cc43e55023 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:34:46.283363 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-98070792-bde1-49ec-997d-e8cc43e55023 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:34:46.285149 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell0:SELECT=2 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:34:46.285803 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell0:SELECT=6 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:34:46.291568 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-98070792-bde1-49ec-997d-e8cc43e55023 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:46.292045 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-98070792-bde1-49ec-997d-e8cc43e55023 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:46.292479 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-98070792-bde1-49ec-997d-e8cc43e55023 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:46.293160 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-98070792-bde1-49ec-997d-e8cc43e55023 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:46.293616 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-98070792-bde1-49ec-997d-e8cc43e55023 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:46.294036 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-98070792-bde1-49ec-997d-e8cc43e55023 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:46.422121 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-98070792-bde1-49ec-997d-e8cc43e55023 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:34:46.429749 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-98070792-bde1-49ec-997d-e8cc43e55023 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44" status: 200 len: 1363 microversion: 2.1 time: 0.151147 Oct 26 11:34:46.430413 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 613/1216] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:34:46 2022] GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:34:46.838773 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-4e1a68ba-1500-40b7-be2e-2b39ff8f2038 req-1f31ae74-bc2b-4870-8f49-f0f6a8f558e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1c26fc3-f012-462e-baa2-fff8a703ff44", "name": "network-vif-plugged", "status": "completed", "tag": "137ec87e-f49b-46aa-8876-ff1784d2c47c"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:34:46.847981 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-4e1a68ba-1500-40b7-be2e-2b39ff8f2038 req-1f31ae74-bc2b-4870-8f49-f0f6a8f558e9 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:46.848454 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-4e1a68ba-1500-40b7-be2e-2b39ff8f2038 req-1f31ae74-bc2b-4870-8f49-f0f6a8f558e9 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:46.848883 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-4e1a68ba-1500-40b7-be2e-2b39ff8f2038 req-1f31ae74-bc2b-4870-8f49-f0f6a8f558e9 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:46.859961 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-4e1a68ba-1500-40b7-be2e-2b39ff8f2038 req-1f31ae74-bc2b-4870-8f49-f0f6a8f558e9 service nova] Creating event network-vif-plugged:137ec87e-f49b-46aa-8876-ff1784d2c47c for instance c1c26fc3-f012-462e-baa2-fff8a703ff44 on hv-cinder-81558 Oct 26 11:34:46.864887 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-4e1a68ba-1500-40b7-be2e-2b39ff8f2038 req-1f31ae74-bc2b-4870-8f49-f0f6a8f558e9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087268 Oct 26 11:34:46.865503 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 604/1217] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:34:47.452737 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-c3508c34-9e4c-4672-8091-7d16925b7a1a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:34:47.453296 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-c3508c34-9e4c-4672-8091-7d16925b7a1a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:34:47.459870 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c3508c34-9e4c-4672-8091-7d16925b7a1a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:47.460352 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c3508c34-9e4c-4672-8091-7d16925b7a1a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:47.460777 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c3508c34-9e4c-4672-8091-7d16925b7a1a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:47.461461 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c3508c34-9e4c-4672-8091-7d16925b7a1a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:47.461906 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c3508c34-9e4c-4672-8091-7d16925b7a1a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:47.462325 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-c3508c34-9e4c-4672-8091-7d16925b7a1a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:47.590918 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-c3508c34-9e4c-4672-8091-7d16925b7a1a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:34:47.598444 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-c3508c34-9e4c-4672-8091-7d16925b7a1a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44" status: 200 len: 1363 microversion: 2.1 time: 0.149748 Oct 26 11:34:47.599033 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 614/1218] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:34:47 2022] GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:34:48.622987 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-eb65ce39-1bb9-4bbc-977b-46210c684a98 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:34:48.623701 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-eb65ce39-1bb9-4bbc-977b-46210c684a98 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:34:48.629815 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eb65ce39-1bb9-4bbc-977b-46210c684a98 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:48.630291 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eb65ce39-1bb9-4bbc-977b-46210c684a98 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:48.630723 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eb65ce39-1bb9-4bbc-977b-46210c684a98 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:48.631433 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eb65ce39-1bb9-4bbc-977b-46210c684a98 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:48.631884 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eb65ce39-1bb9-4bbc-977b-46210c684a98 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:48.632387 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eb65ce39-1bb9-4bbc-977b-46210c684a98 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:48.767414 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-eb65ce39-1bb9-4bbc-977b-46210c684a98 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:34:48.775126 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-eb65ce39-1bb9-4bbc-977b-46210c684a98 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44" status: 200 len: 1363 microversion: 2.1 time: 0.156991 Oct 26 11:34:48.775686 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 605/1219] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:34:48 2022] GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:34:49.797472 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-6e8007ff-32c4-4e10-98ec-0e3ea8936b5d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:34:49.798083 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-6e8007ff-32c4-4e10-98ec-0e3ea8936b5d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:34:49.804489 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6e8007ff-32c4-4e10-98ec-0e3ea8936b5d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:49.804969 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6e8007ff-32c4-4e10-98ec-0e3ea8936b5d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:49.805391 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6e8007ff-32c4-4e10-98ec-0e3ea8936b5d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:49.806068 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6e8007ff-32c4-4e10-98ec-0e3ea8936b5d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:49.806517 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6e8007ff-32c4-4e10-98ec-0e3ea8936b5d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:49.806965 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-6e8007ff-32c4-4e10-98ec-0e3ea8936b5d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:49.931753 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-6e8007ff-32c4-4e10-98ec-0e3ea8936b5d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:34:49.939257 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-6e8007ff-32c4-4e10-98ec-0e3ea8936b5d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44" status: 200 len: 1550 microversion: 2.1 time: 0.145660 Oct 26 11:34:49.939823 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 615/1220] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:34:49 2022] GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44 => generated 1550 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:34:49.962195 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-5665f674-bcdb-4b3e-92e4-c400af176334 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:34:49.962718 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-5665f674-bcdb-4b3e-92e4-c400af176334 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:34:49.969158 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5665f674-bcdb-4b3e-92e4-c400af176334 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:49.969645 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5665f674-bcdb-4b3e-92e4-c400af176334 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:49.970092 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5665f674-bcdb-4b3e-92e4-c400af176334 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:49.970783 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5665f674-bcdb-4b3e-92e4-c400af176334 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:49.971268 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5665f674-bcdb-4b3e-92e4-c400af176334 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:49.971695 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5665f674-bcdb-4b3e-92e4-c400af176334 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:50.046555 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-5665f674-bcdb-4b3e-92e4-c400af176334 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088791 Oct 26 11:34:50.047197 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 606/1221] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Oct 26 11:34:49 2022] GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:34:51.076817 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [req-08f3facf-417e-4a35-9f88-b461ab565cbd req-8d5a4839-746b-47f3-b31d-08b2e5c68077 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1c26fc3-f012-462e-baa2-fff8a703ff44", "tag": "137ec87e-f49b-46aa-8876-ff1784d2c47c"}]} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:34:51.087533 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-08f3facf-417e-4a35-9f88-b461ab565cbd req-8d5a4839-746b-47f3-b31d-08b2e5c68077 service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:34:51.088006 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-08f3facf-417e-4a35-9f88-b461ab565cbd req-8d5a4839-746b-47f3-b31d-08b2e5c68077 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:34:51.088445 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [req-08f3facf-417e-4a35-9f88-b461ab565cbd req-8d5a4839-746b-47f3-b31d-08b2e5c68077 service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:34:51.103179 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.compute.server_external_events [req-08f3facf-417e-4a35-9f88-b461ab565cbd req-8d5a4839-746b-47f3-b31d-08b2e5c68077 service nova] Creating event network-changed:137ec87e-f49b-46aa-8876-ff1784d2c47c for instance c1c26fc3-f012-462e-baa2-fff8a703ff44 on hv-cinder-81558 Oct 26 11:34:51.108533 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [req-08f3facf-417e-4a35-9f88-b461ab565cbd req-8d5a4839-746b-47f3-b31d-08b2e5c68077 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096206 Oct 26 11:34:51.109155 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 616/1222] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 26 11:35:59.751135 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:35:59.751897 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG dbcounter [-] [119305] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:35:59.752680 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 26 11:35:59.752826 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Wed Oct 26 11:35:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44/ips (ip 10.222.0.42) !!! Oct 26 11:35:59.758012 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-d045d9e3-e44a-40b5-a155-5cd6c2cc5150 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:35:59.763995 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-d045d9e3-e44a-40b5-a155-5cd6c2cc5150 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:35:59.765536 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d045d9e3-e44a-40b5-a155-5cd6c2cc5150 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:35:59.766024 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d045d9e3-e44a-40b5-a155-5cd6c2cc5150 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:35:59.766468 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d045d9e3-e44a-40b5-a155-5cd6c2cc5150 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:35:59.767192 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d045d9e3-e44a-40b5-a155-5cd6c2cc5150 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:35:59.767652 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d045d9e3-e44a-40b5-a155-5cd6c2cc5150 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:35:59.768189 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-d045d9e3-e44a-40b5-a155-5cd6c2cc5150 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:35:59.793499 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-d045d9e3-e44a-40b5-a155-5cd6c2cc5150 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44/ips" status: 200 len: 147 microversion: 2.1 time: 0.044637 Oct 26 11:35:59.794057 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 607/1223] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Oct 26 11:35:59 2022] GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44/ips => generated 147 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:36:01.466431 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:36:01.467206 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=78 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:36:01.472074 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-f185bf6d-d4cb-408d-aa23-ba624a8a7b7e tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65181b15-0fb0-4275-b02a-d61c135bf6db"}} {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:36:01.475057 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-f185bf6d-d4cb-408d-aa23-ba624a8a7b7e tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:36:01.481228 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f185bf6d-d4cb-408d-aa23-ba624a8a7b7e tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:01.481712 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f185bf6d-d4cb-408d-aa23-ba624a8a7b7e tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:01.482255 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f185bf6d-d4cb-408d-aa23-ba624a8a7b7e tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:01.482974 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f185bf6d-d4cb-408d-aa23-ba624a8a7b7e tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:01.483444 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f185bf6d-d4cb-408d-aa23-ba624a8a7b7e tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:01.483863 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-f185bf6d-d4cb-408d-aa23-ba624a8a7b7e tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:02.241606 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-f185bf6d-d4cb-408d-aa23-ba624a8a7b7e tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "POST /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.777319 Oct 26 11:36:02.242249 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 617/1224] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Oct 26 11:36:01 2022] POST /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44/os-volume_attachments => generated 194 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:36:09.771784 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-c78c8ab1-9c37-4c02-88ed-b0f364263c2b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:36:09.774051 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-c78c8ab1-9c37-4c02-88ed-b0f364263c2b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:36:09.782297 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c78c8ab1-9c37-4c02-88ed-b0f364263c2b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:09.782771 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c78c8ab1-9c37-4c02-88ed-b0f364263c2b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:09.783225 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c78c8ab1-9c37-4c02-88ed-b0f364263c2b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:09.783911 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c78c8ab1-9c37-4c02-88ed-b0f364263c2b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:09.784362 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c78c8ab1-9c37-4c02-88ed-b0f364263c2b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:09.784816 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-c78c8ab1-9c37-4c02-88ed-b0f364263c2b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:09.814760 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-c78c8ab1-9c37-4c02-88ed-b0f364263c2b tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047749 Oct 26 11:36:09.815347 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 608/1225] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Oct 26 11:36:09 2022] GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:36:09.827843 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-9df59d11-3443-44a3-be5e-c2a10dae27ca tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:36:09.828417 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-9df59d11-3443-44a3-be5e-c2a10dae27ca tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:36:09.835382 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9df59d11-3443-44a3-be5e-c2a10dae27ca tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:09.835876 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9df59d11-3443-44a3-be5e-c2a10dae27ca tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:09.836317 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9df59d11-3443-44a3-be5e-c2a10dae27ca tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:09.837045 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9df59d11-3443-44a3-be5e-c2a10dae27ca tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:09.837536 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9df59d11-3443-44a3-be5e-c2a10dae27ca tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:09.837965 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-9df59d11-3443-44a3-be5e-c2a10dae27ca tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:09.866457 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-9df59d11-3443-44a3-be5e-c2a10dae27ca tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44/os-volume_attachments/65181b15-0fb0-4275-b02a-d61c135bf6db" status: 200 len: 194 microversion: 2.1 time: 0.043597 Oct 26 11:36:09.867074 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 618/1226] 10.222.0.42 () {58 vars in 1413 bytes} [Wed Oct 26 11:36:09 2022] GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44/os-volume_attachments/65181b15-0fb0-4275-b02a-d61c135bf6db => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:36:11.369316 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-7bf52547-64bc-427e-9724-a4dd2149c488 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0780868f-6527-473f-b392-ca09ad5988c7"}} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:36:11.371667 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-7bf52547-64bc-427e-9724-a4dd2149c488 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:36:11.378807 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7bf52547-64bc-427e-9724-a4dd2149c488 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:11.379309 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7bf52547-64bc-427e-9724-a4dd2149c488 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:11.379745 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7bf52547-64bc-427e-9724-a4dd2149c488 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:11.380924 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7bf52547-64bc-427e-9724-a4dd2149c488 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:11.381376 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7bf52547-64bc-427e-9724-a4dd2149c488 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:11.381797 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-7bf52547-64bc-427e-9724-a4dd2149c488 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:12.121724 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-7bf52547-64bc-427e-9724-a4dd2149c488 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "POST /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.756502 Oct 26 11:36:12.122377 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 609/1227] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Oct 26 11:36:11 2022] POST /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44/os-volume_attachments => generated 194 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:36:20.702269 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-e944f4c9-c548-460a-a3d4-02430457812d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:36:20.704526 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-e944f4c9-c548-460a-a3d4-02430457812d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:36:20.710221 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_api:SELECT=4 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:36:20.710221 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG dbcounter [-] [119306] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 26 11:36:20.712231 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e944f4c9-c548-460a-a3d4-02430457812d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:20.712716 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e944f4c9-c548-460a-a3d4-02430457812d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:20.713151 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e944f4c9-c548-460a-a3d4-02430457812d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:20.713844 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e944f4c9-c548-460a-a3d4-02430457812d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:20.714367 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e944f4c9-c548-460a-a3d4-02430457812d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:20.714788 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-e944f4c9-c548-460a-a3d4-02430457812d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:20.744988 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-e944f4c9-c548-460a-a3d4-02430457812d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046671 Oct 26 11:36:20.745554 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 619/1228] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Oct 26 11:36:20 2022] GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:36:20.918705 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-a30bf052-970e-433a-887a-e7bfbdae27c0 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:36:20.919307 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-a30bf052-970e-433a-887a-e7bfbdae27c0 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:36:20.925387 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a30bf052-970e-433a-887a-e7bfbdae27c0 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:20.925866 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a30bf052-970e-433a-887a-e7bfbdae27c0 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:20.927103 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a30bf052-970e-433a-887a-e7bfbdae27c0 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:20.927791 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a30bf052-970e-433a-887a-e7bfbdae27c0 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:20.928243 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a30bf052-970e-433a-887a-e7bfbdae27c0 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:20.928664 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-a30bf052-970e-433a-887a-e7bfbdae27c0 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:20.956865 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-a30bf052-970e-433a-887a-e7bfbdae27c0 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44/os-volume_attachments/65181b15-0fb0-4275-b02a-d61c135bf6db" status: 200 len: 194 microversion: 2.1 time: 0.043224 Oct 26 11:36:20.957440 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 610/1229] 10.222.0.42 () {58 vars in 1413 bytes} [Wed Oct 26 11:36:20 2022] GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44/os-volume_attachments/65181b15-0fb0-4275-b02a-d61c135bf6db => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:36:20.968457 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-56d7128f-76e7-476c-a798-4ed55f7c16e5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:36:20.968956 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-56d7128f-76e7-476c-a798-4ed55f7c16e5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:36:20.975956 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-56d7128f-76e7-476c-a798-4ed55f7c16e5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:20.976445 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-56d7128f-76e7-476c-a798-4ed55f7c16e5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:20.976886 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-56d7128f-76e7-476c-a798-4ed55f7c16e5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:20.977579 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-56d7128f-76e7-476c-a798-4ed55f7c16e5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:20.978033 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-56d7128f-76e7-476c-a798-4ed55f7c16e5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:20.978467 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-56d7128f-76e7-476c-a798-4ed55f7c16e5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:21.058159 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.objects.instance [None req-56d7128f-76e7-476c-a798-4ed55f7c16e5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lazy-loading 'services' on Instance uuid c1c26fc3-f012-462e-baa2-fff8a703ff44 {{(pid=119306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:36:21.235926 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-56d7128f-76e7-476c-a798-4ed55f7c16e5 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44/os-volume_attachments/65181b15-0fb0-4275-b02a-d61c135bf6db" status: 202 len: 0 microversion: 2.1 time: 0.271805 Oct 26 11:36:21.236454 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 620/1230] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Oct 26 11:36:20 2022] DELETE /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44/os-volume_attachments/65181b15-0fb0-4275-b02a-d61c135bf6db => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 11:36:23.413214 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-8d93b30e-56f7-46e4-bb39-9e7b5d28f06a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:36:23.413791 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-8d93b30e-56f7-46e4-bb39-9e7b5d28f06a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:36:23.419689 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8d93b30e-56f7-46e4-bb39-9e7b5d28f06a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:23.420166 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8d93b30e-56f7-46e4-bb39-9e7b5d28f06a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:23.420597 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8d93b30e-56f7-46e4-bb39-9e7b5d28f06a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:23.421283 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8d93b30e-56f7-46e4-bb39-9e7b5d28f06a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:23.421728 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8d93b30e-56f7-46e4-bb39-9e7b5d28f06a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:23.422145 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8d93b30e-56f7-46e4-bb39-9e7b5d28f06a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:23.450738 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-8d93b30e-56f7-46e4-bb39-9e7b5d28f06a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44/os-volume_attachments/0780868f-6527-473f-b392-ca09ad5988c7" status: 200 len: 194 microversion: 2.1 time: 0.042247 Oct 26 11:36:23.451344 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 611/1231] 10.222.0.42 () {58 vars in 1413 bytes} [Wed Oct 26 11:36:23 2022] GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44/os-volume_attachments/0780868f-6527-473f-b392-ca09ad5988c7 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:36:23.463250 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-a63059f0-2d83-492b-a4fd-f6f126ceca96 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:36:23.463866 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-a63059f0-2d83-492b-a4fd-f6f126ceca96 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:36:23.469973 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a63059f0-2d83-492b-a4fd-f6f126ceca96 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:23.470456 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a63059f0-2d83-492b-a4fd-f6f126ceca96 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:23.470928 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a63059f0-2d83-492b-a4fd-f6f126ceca96 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:23.471622 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a63059f0-2d83-492b-a4fd-f6f126ceca96 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:23.472078 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a63059f0-2d83-492b-a4fd-f6f126ceca96 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:23.472504 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a63059f0-2d83-492b-a4fd-f6f126ceca96 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:23.551980 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.objects.instance [None req-a63059f0-2d83-492b-a4fd-f6f126ceca96 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lazy-loading 'services' on Instance uuid c1c26fc3-f012-462e-baa2-fff8a703ff44 {{(pid=119306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:36:23.962533 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-a63059f0-2d83-492b-a4fd-f6f126ceca96 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44/os-volume_attachments/0780868f-6527-473f-b392-ca09ad5988c7" status: 202 len: 0 microversion: 2.1 time: 0.504013 Oct 26 11:36:23.963170 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 621/1232] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Oct 26 11:36:23 2022] DELETE /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44/os-volume_attachments/0780868f-6527-473f-b392-ca09ad5988c7 => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 11:36:25.135038 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-6514bfc3-f7c4-4cf1-b4e1-5312788e5737 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:36:25.137315 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-6514bfc3-f7c4-4cf1-b4e1-5312788e5737 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:36:25.143746 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6514bfc3-f7c4-4cf1-b4e1-5312788e5737 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:25.144230 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6514bfc3-f7c4-4cf1-b4e1-5312788e5737 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:25.145430 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6514bfc3-f7c4-4cf1-b4e1-5312788e5737 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:25.146118 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6514bfc3-f7c4-4cf1-b4e1-5312788e5737 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:25.146574 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6514bfc3-f7c4-4cf1-b4e1-5312788e5737 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:25.147026 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-6514bfc3-f7c4-4cf1-b4e1-5312788e5737 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:25.176007 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-6514bfc3-f7c4-4cf1-b4e1-5312788e5737 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044918 Oct 26 11:36:25.176586 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 612/1233] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Oct 26 11:36:25 2022] GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 11:36:25.291622 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-94a208bd-b976-4efb-9366-adf279365feb tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:36:25.293979 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-94a208bd-b976-4efb-9366-adf279365feb tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:36:25.300100 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-94a208bd-b976-4efb-9366-adf279365feb tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:25.300583 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-94a208bd-b976-4efb-9366-adf279365feb tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:25.301085 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-94a208bd-b976-4efb-9366-adf279365feb tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:25.301774 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-94a208bd-b976-4efb-9366-adf279365feb tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:25.302226 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-94a208bd-b976-4efb-9366-adf279365feb tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:25.302649 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-94a208bd-b976-4efb-9366-adf279365feb tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:25.330596 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-94a208bd-b976-4efb-9366-adf279365feb tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043783 Oct 26 11:36:25.331175 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 622/1234] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Oct 26 11:36:25 2022] GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 26 11:36:25.392430 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-8dccd8d9-608d-4ddc-a7bc-3e0df757faa9 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:36:25.392926 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-8dccd8d9-608d-4ddc-a7bc-3e0df757faa9 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:36:25.399493 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8dccd8d9-608d-4ddc-a7bc-3e0df757faa9 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:25.399976 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8dccd8d9-608d-4ddc-a7bc-3e0df757faa9 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:25.400413 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8dccd8d9-608d-4ddc-a7bc-3e0df757faa9 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:25.401098 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8dccd8d9-608d-4ddc-a7bc-3e0df757faa9 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:25.401562 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8dccd8d9-608d-4ddc-a7bc-3e0df757faa9 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:25.401976 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-8dccd8d9-608d-4ddc-a7bc-3e0df757faa9 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:25.427902 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-8dccd8d9-608d-4ddc-a7bc-3e0df757faa9 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Going to try to terminate instance {{(pid=119305) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 26 11:36:25.721841 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-8dccd8d9-608d-4ddc-a7bc-3e0df757faa9 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44" status: 204 len: 0 microversion: 2.1 time: 0.332936 Oct 26 11:36:25.722438 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 613/1235] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Oct 26 11:36:25 2022] DELETE /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 26 11:36:25.731051 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-3c42ea5a-3462-4f5d-beff-887221b05a4a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:36:25.731696 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-3c42ea5a-3462-4f5d-beff-887221b05a4a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:36:25.737653 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3c42ea5a-3462-4f5d-beff-887221b05a4a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:25.738132 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3c42ea5a-3462-4f5d-beff-887221b05a4a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:25.738567 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3c42ea5a-3462-4f5d-beff-887221b05a4a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:25.739297 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3c42ea5a-3462-4f5d-beff-887221b05a4a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:25.739756 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3c42ea5a-3462-4f5d-beff-887221b05a4a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:25.740177 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-3c42ea5a-3462-4f5d-beff-887221b05a4a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:25.872077 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-3c42ea5a-3462-4f5d-beff-887221b05a4a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:36:25.880273 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-3c42ea5a-3462-4f5d-beff-887221b05a4a tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44" status: 200 len: 1675 microversion: 2.1 time: 0.153348 Oct 26 11:36:25.880841 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 623/1236] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:36:25 2022] GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:36:26.904137 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-5cf0113a-5aad-4515-960e-d5f4b839f228 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:36:26.904839 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-5cf0113a-5aad-4515-960e-d5f4b839f228 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:36:26.911721 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5cf0113a-5aad-4515-960e-d5f4b839f228 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:26.912199 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5cf0113a-5aad-4515-960e-d5f4b839f228 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:26.912638 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5cf0113a-5aad-4515-960e-d5f4b839f228 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:26.913326 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5cf0113a-5aad-4515-960e-d5f4b839f228 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:26.913779 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5cf0113a-5aad-4515-960e-d5f4b839f228 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:26.914204 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-5cf0113a-5aad-4515-960e-d5f4b839f228 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:27.041300 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.policy [None req-5cf0113a-5aad-4515-960e-d5f4b839f228 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119305) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:36:27.048886 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-5cf0113a-5aad-4515-960e-d5f4b839f228 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44" status: 200 len: 1675 microversion: 2.1 time: 0.148946 Oct 26 11:36:27.049452 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 614/1237] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:36:26 2022] GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:36:28.073313 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-60a79732-90d0-4d6e-8955-92a8c99fcb50 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:36:28.073881 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-60a79732-90d0-4d6e-8955-92a8c99fcb50 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:36:28.080169 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-60a79732-90d0-4d6e-8955-92a8c99fcb50 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:28.080652 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-60a79732-90d0-4d6e-8955-92a8c99fcb50 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:28.081087 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-60a79732-90d0-4d6e-8955-92a8c99fcb50 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:28.081782 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-60a79732-90d0-4d6e-8955-92a8c99fcb50 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:28.082238 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-60a79732-90d0-4d6e-8955-92a8c99fcb50 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:28.082664 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-60a79732-90d0-4d6e-8955-92a8c99fcb50 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:28.263973 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-60a79732-90d0-4d6e-8955-92a8c99fcb50 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:36:28.272193 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-60a79732-90d0-4d6e-8955-92a8c99fcb50 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44" status: 200 len: 1675 microversion: 2.1 time: 0.202869 Oct 26 11:36:28.272767 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 624/1238] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:36:28 2022] GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44 => generated 1675 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:36:28.817640 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [req-dc2521a0-9684-4cb0-b04e-6e8ab0b5ca3d req-2a60b2b4-ae67-42a8-b19c-c58cc53d2c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1c26fc3-f012-462e-baa2-fff8a703ff44", "name": "network-vif-deleted", "tag": "137ec87e-f49b-46aa-8876-ff1784d2c47c"}]} {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 26 11:36:28.828359 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-dc2521a0-9684-4cb0-b04e-6e8ab0b5ca3d req-2a60b2b4-ae67-42a8-b19c-c58cc53d2c4a service nova] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:28.828926 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-dc2521a0-9684-4cb0-b04e-6e8ab0b5ca3d req-2a60b2b4-ae67-42a8-b19c-c58cc53d2c4a service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:28.829363 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [req-dc2521a0-9684-4cb0-b04e-6e8ab0b5ca3d req-2a60b2b4-ae67-42a8-b19c-c58cc53d2c4a service nova] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:28.842642 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.compute.server_external_events [req-dc2521a0-9684-4cb0-b04e-6e8ab0b5ca3d req-2a60b2b4-ae67-42a8-b19c-c58cc53d2c4a service nova] Creating event network-vif-deleted:137ec87e-f49b-46aa-8876-ff1784d2c47c for instance c1c26fc3-f012-462e-baa2-fff8a703ff44 on hv-cinder-81558 Oct 26 11:36:28.849695 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [req-dc2521a0-9684-4cb0-b04e-6e8ab0b5ca3d req-2a60b2b4-ae67-42a8-b19c-c58cc53d2c4a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162463 Oct 26 11:36:28.850397 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 615/1239] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Oct 26 11:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 26 11:36:29.296077 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-5769ff28-7cea-41e8-99d5-0ec733778053 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:36:29.296747 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-5769ff28-7cea-41e8-99d5-0ec733778053 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:36:29.303151 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5769ff28-7cea-41e8-99d5-0ec733778053 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:29.303640 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5769ff28-7cea-41e8-99d5-0ec733778053 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:29.304075 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5769ff28-7cea-41e8-99d5-0ec733778053 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:29.304767 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5769ff28-7cea-41e8-99d5-0ec733778053 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:29.305219 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5769ff28-7cea-41e8-99d5-0ec733778053 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:29.305643 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5769ff28-7cea-41e8-99d5-0ec733778053 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:29.338971 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5769ff28-7cea-41e8-99d5-0ec733778053 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:29.339468 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5769ff28-7cea-41e8-99d5-0ec733778053 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:29.339817 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-5769ff28-7cea-41e8-99d5-0ec733778053 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:29.340254 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.objects.instance [None req-5769ff28-7cea-41e8-99d5-0ec733778053 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lazy-loading 'fault' on Instance uuid c1c26fc3-f012-462e-baa2-fff8a703ff44 {{(pid=119306) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 26 11:36:29.381521 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.policy [None req-5769ff28-7cea-41e8-99d5-0ec733778053 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80087d6fbe284b02b20c64ce3237d3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78491741fc7450b932b7a43e5d3bb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119306) authorize /opt/stack/nova/nova/policy.py:199}} Oct 26 11:36:29.389586 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-5769ff28-7cea-41e8-99d5-0ec733778053 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44" status: 200 len: 1327 microversion: 2.1 time: 0.097381 Oct 26 11:36:29.390174 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 625/1240] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:36:29 2022] GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44 => generated 1327 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 26 11:36:30.414549 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-675e36a2-e874-482d-be93-1a26c8797378 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:36:30.415299 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-675e36a2-e874-482d-be93-1a26c8797378 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:36:30.421832 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-675e36a2-e874-482d-be93-1a26c8797378 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:30.422308 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-675e36a2-e874-482d-be93-1a26c8797378 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:30.422738 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-675e36a2-e874-482d-be93-1a26c8797378 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:30.423440 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-675e36a2-e874-482d-be93-1a26c8797378 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:30.423888 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-675e36a2-e874-482d-be93-1a26c8797378 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:30.424306 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-675e36a2-e874-482d-be93-1a26c8797378 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:30.437162 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.wsgi [None req-675e36a2-e874-482d-be93-1a26c8797378 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] HTTP exception thrown: Instance c1c26fc3-f012-462e-baa2-fff8a703ff44 could not be found. Oct 26 11:36:30.438942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-675e36a2-e874-482d-be93-1a26c8797378 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Request method failure captured: Oct 26 11:36:30.438942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: request: GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44 HTTP/1.1 Oct 26 11:36:30.438942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept: application/json Oct 26 11:36:30.438942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept-Encoding: identity Oct 26 11:36:30.438942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Connection: close Oct 26 11:36:30.438942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Length: 0 Oct 26 11:36:30.438942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Type: application/json Oct 26 11:36:30.438942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Host: 10.222.0.42 Oct 26 11:36:30.438942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Openstack-System-Scope: None Oct 26 11:36:30.438942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: User-Agent: python-urllib3/1.26.12 Oct 26 11:36:30.438942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Auth-Token: gAAAAABjWRoWOVoEZSDq11o_WPUxBfBH5X1Tn0zByJ9tNdUyQnICBOpyLC5fja5T9eXSP4eNgIe-5a9uZ3V9VSOWodiW2qNxAqGTJl8udvJCT-0n8YZSK3WDSE2tnBNa9VavTFyxaQA9Gu7NcgrVm_xLJhjxds376v0Q-RhGOUhTfbEV8PcseGQ Oct 26 11:36:30.438942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Id: None Oct 26 11:36:30.438942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Name: None Oct 26 11:36:30.438942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Identity-Status: Confirmed Oct 26 11:36:30.438942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Is-Admin-Project: True Oct 26 11:36:30.438942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Id: default Oct 26 11:36:30.438942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Name: Default Oct 26 11:36:30.438942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Id: b78491741fc7450b932b7a43e5d3bb92 Oct 26 11:36:30.438942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Name: tempest-AttachVolumeTestJSON-554587477 Oct 26 11:36:30.438942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Role: member,reader Oct 26 11:36:30.438942 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Roles: member,reader Oct 26 11:36:30.440728 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b78491741fc7450b932b7a43e5d3bb92", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b78491741fc7450b932b7a43e5d3bb92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b78491741fc7450b932b7a43e5d3bb92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b78491741fc7450b932b7a43e5d3bb92"}]}] Oct 26 11:36:30.440728 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant: tempest-AttachVolumeTestJSON-554587477 Oct 26 11:36:30.440728 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Id: b78491741fc7450b932b7a43e5d3bb92 Oct 26 11:36:30.440728 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Name: tempest-AttachVolumeTestJSON-554587477 Oct 26 11:36:30.440728 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User: tempest-AttachVolumeTestJSON-554587477-project Oct 26 11:36:30.440728 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Id: default Oct 26 11:36:30.440728 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Name: Default Oct 26 11:36:30.440728 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Id: 80087d6fbe284b02b20c64ce3237d3b5 Oct 26 11:36:30.440728 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Name: tempest-AttachVolumeTestJSON-554587477-project Oct 26 11:36:30.440728 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: method: > Oct 26 11:36:30.440728 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: exception: Instance c1c26fc3-f012-462e-baa2-fff8a703ff44 could not be found. Oct 26 11:36:30.440728 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: action_args: {'id': 'c1c26fc3-f012-462e-baa2-fff8a703ff44'} Oct 26 11:36:30.441729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:36:30.441729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:36:30.441729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:36:30.441729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:36:30.441729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:36:30.441729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:36:30.441729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:36:30.441729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:36:30.441729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:36:30.441729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:36:30.441729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1c26fc3-f012-462e-baa2-fff8a703ff44 could not be found. Oct 26 11:36:30.441729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:36:30.441729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:36:30.441729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:36:30.441729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:36:30.441729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:36:30.441729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:36:30.441729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:36:30.441729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:36:30.441729 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:36:30.443464 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:36:30.443464 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 11:36:30.443464 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 11:36:30.443464 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:36:30.443464 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:36:30.443464 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:36:30.443464 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:36:30.443464 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1c26fc3-f012-462e-baa2-fff8a703ff44 could not be found. Oct 26 11:36:30.443464 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:36:30.443464 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:36:30.443464 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:36:30.443464 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:36:30.443464 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:36:30.443464 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:36:30.443464 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:36:30.443464 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:36:30.443464 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1c26fc3-f012-462e-baa2-fff8a703ff44 could not be found. Oct 26 11:36:30.443464 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:36:30.444929 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-675e36a2-e874-482d-be93-1a26c8797378 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Returning 404 to user: Instance c1c26fc3-f012-462e-baa2-fff8a703ff44 could not be found. {{(pid=119305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:36:30.444929 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-675e36a2-e874-482d-be93-1a26c8797378 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44" status: 404 len: 111 microversion: 2.1 time: 0.030548 Oct 26 11:36:30.444929 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 616/1241] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:36:30 2022] GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:36:30.449190 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-3e4496a5-8cb5-4edd-a2b4-fb775bb33b5d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '.version_select at 0x7f6b93a34280>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:36:30.522796 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-3e4496a5-8cb5-4edd-a2b4-fb775bb33b5d tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-788185745" status: 202 len: 0 microversion: 2.1 time: 0.077410 Oct 26 11:36:30.523388 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 626/1242] 10.222.0.42 () {58 vars in 1218 bytes} [Wed Oct 26 11:36:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-788185745 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 26 11:36:33.765300 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-eda1be35-b734-4214-96bf-88de1079ee73 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:36:33.765783 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-eda1be35-b734-4214-96bf-88de1079ee73 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:36:33.772969 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eda1be35-b734-4214-96bf-88de1079ee73 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:33.773444 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eda1be35-b734-4214-96bf-88de1079ee73 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:33.773877 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eda1be35-b734-4214-96bf-88de1079ee73 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:33.774557 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eda1be35-b734-4214-96bf-88de1079ee73 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:33.775054 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eda1be35-b734-4214-96bf-88de1079ee73 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:33.775471 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-eda1be35-b734-4214-96bf-88de1079ee73 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:33.789129 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.wsgi [None req-eda1be35-b734-4214-96bf-88de1079ee73 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] HTTP exception thrown: Instance c1c26fc3-f012-462e-baa2-fff8a703ff44 could not be found. Oct 26 11:36:33.790628 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-eda1be35-b734-4214-96bf-88de1079ee73 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Request method failure captured: Oct 26 11:36:33.790628 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: request: DELETE /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44 HTTP/1.1 Oct 26 11:36:33.790628 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept: application/json Oct 26 11:36:33.790628 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept-Encoding: identity Oct 26 11:36:33.790628 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Connection: close Oct 26 11:36:33.790628 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Length: 0 Oct 26 11:36:33.790628 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Type: application/json Oct 26 11:36:33.790628 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Host: 10.222.0.42 Oct 26 11:36:33.790628 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Openstack-System-Scope: None Oct 26 11:36:33.790628 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: User-Agent: python-urllib3/1.26.12 Oct 26 11:36:33.790628 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Auth-Token: gAAAAABjWRoWOVoEZSDq11o_WPUxBfBH5X1Tn0zByJ9tNdUyQnICBOpyLC5fja5T9eXSP4eNgIe-5a9uZ3V9VSOWodiW2qNxAqGTJl8udvJCT-0n8YZSK3WDSE2tnBNa9VavTFyxaQA9Gu7NcgrVm_xLJhjxds376v0Q-RhGOUhTfbEV8PcseGQ Oct 26 11:36:33.790628 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Id: None Oct 26 11:36:33.790628 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Name: None Oct 26 11:36:33.790628 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Identity-Status: Confirmed Oct 26 11:36:33.790628 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Is-Admin-Project: True Oct 26 11:36:33.790628 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Id: default Oct 26 11:36:33.790628 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Name: Default Oct 26 11:36:33.790628 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Id: b78491741fc7450b932b7a43e5d3bb92 Oct 26 11:36:33.790628 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Name: tempest-AttachVolumeTestJSON-554587477 Oct 26 11:36:33.790628 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Role: member,reader Oct 26 11:36:33.790628 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Roles: member,reader Oct 26 11:36:33.792354 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b78491741fc7450b932b7a43e5d3bb92", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b78491741fc7450b932b7a43e5d3bb92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b78491741fc7450b932b7a43e5d3bb92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b78491741fc7450b932b7a43e5d3bb92"}]}] Oct 26 11:36:33.792354 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant: tempest-AttachVolumeTestJSON-554587477 Oct 26 11:36:33.792354 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Id: b78491741fc7450b932b7a43e5d3bb92 Oct 26 11:36:33.792354 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Name: tempest-AttachVolumeTestJSON-554587477 Oct 26 11:36:33.792354 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User: tempest-AttachVolumeTestJSON-554587477-project Oct 26 11:36:33.792354 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Id: default Oct 26 11:36:33.792354 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Name: Default Oct 26 11:36:33.792354 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Id: 80087d6fbe284b02b20c64ce3237d3b5 Oct 26 11:36:33.792354 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Name: tempest-AttachVolumeTestJSON-554587477-project Oct 26 11:36:33.792354 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: method: > Oct 26 11:36:33.792354 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: exception: Instance c1c26fc3-f012-462e-baa2-fff8a703ff44 could not be found. Oct 26 11:36:33.792354 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: action_args: {'id': 'c1c26fc3-f012-462e-baa2-fff8a703ff44'} Oct 26 11:36:33.793396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:36:33.793396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:36:33.793396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:36:33.793396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:36:33.793396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:36:33.793396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:36:33.793396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:36:33.793396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:36:33.793396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:36:33.793396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:36:33.793396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1c26fc3-f012-462e-baa2-fff8a703ff44 could not be found. Oct 26 11:36:33.793396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:36:33.793396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:36:33.793396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:36:33.793396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:36:33.793396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:36:33.793396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:36:33.793396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:36:33.793396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:36:33.793396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:36:33.795120 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:36:33.795120 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 11:36:33.795120 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 11:36:33.795120 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 11:36:33.795120 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 11:36:33.795120 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:36:33.795120 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:36:33.795120 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:36:33.795120 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:36:33.795120 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1c26fc3-f012-462e-baa2-fff8a703ff44 could not be found. Oct 26 11:36:33.795120 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:36:33.795120 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:36:33.795120 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:36:33.795120 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:36:33.795120 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:36:33.795120 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:36:33.795120 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:36:33.795120 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:36:33.795120 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1c26fc3-f012-462e-baa2-fff8a703ff44 could not be found. Oct 26 11:36:33.795120 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:36:33.796739 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-eda1be35-b734-4214-96bf-88de1079ee73 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Returning 404 to user: Instance c1c26fc3-f012-462e-baa2-fff8a703ff44 could not be found. {{(pid=119305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:36:33.796739 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-eda1be35-b734-4214-96bf-88de1079ee73 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44" status: 404 len: 111 microversion: 2.1 time: 0.030526 Oct 26 11:36:33.796739 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 617/1243] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Oct 26 11:36:33 2022] DELETE /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:36:33.801229 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-8a06265b-6c28-4dcc-91d8-8b530c8e10f2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:36:33.801843 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-8a06265b-6c28-4dcc-91d8-8b530c8e10f2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: c1c26fc3-f012-462e-baa2-fff8a703ff44] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:36:33.808364 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8a06265b-6c28-4dcc-91d8-8b530c8e10f2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:33.808846 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8a06265b-6c28-4dcc-91d8-8b530c8e10f2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:33.809285 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8a06265b-6c28-4dcc-91d8-8b530c8e10f2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:33.809976 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8a06265b-6c28-4dcc-91d8-8b530c8e10f2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:33.810429 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8a06265b-6c28-4dcc-91d8-8b530c8e10f2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:33.810880 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-8a06265b-6c28-4dcc-91d8-8b530c8e10f2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:33.823617 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.wsgi [None req-8a06265b-6c28-4dcc-91d8-8b530c8e10f2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] HTTP exception thrown: Instance c1c26fc3-f012-462e-baa2-fff8a703ff44 could not be found. Oct 26 11:36:33.825257 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-8a06265b-6c28-4dcc-91d8-8b530c8e10f2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Request method failure captured: Oct 26 11:36:33.825257 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: request: GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44 HTTP/1.1 Oct 26 11:36:33.825257 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept: application/json Oct 26 11:36:33.825257 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept-Encoding: identity Oct 26 11:36:33.825257 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Connection: close Oct 26 11:36:33.825257 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Length: 0 Oct 26 11:36:33.825257 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Type: application/json Oct 26 11:36:33.825257 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Host: 10.222.0.42 Oct 26 11:36:33.825257 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Openstack-System-Scope: None Oct 26 11:36:33.825257 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: User-Agent: python-urllib3/1.26.12 Oct 26 11:36:33.825257 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Auth-Token: gAAAAABjWRoWOVoEZSDq11o_WPUxBfBH5X1Tn0zByJ9tNdUyQnICBOpyLC5fja5T9eXSP4eNgIe-5a9uZ3V9VSOWodiW2qNxAqGTJl8udvJCT-0n8YZSK3WDSE2tnBNa9VavTFyxaQA9Gu7NcgrVm_xLJhjxds376v0Q-RhGOUhTfbEV8PcseGQ Oct 26 11:36:33.825257 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Id: None Oct 26 11:36:33.825257 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Name: None Oct 26 11:36:33.825257 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Identity-Status: Confirmed Oct 26 11:36:33.825257 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Is-Admin-Project: True Oct 26 11:36:33.825257 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Id: default Oct 26 11:36:33.825257 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Name: Default Oct 26 11:36:33.825257 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Id: b78491741fc7450b932b7a43e5d3bb92 Oct 26 11:36:33.825257 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Name: tempest-AttachVolumeTestJSON-554587477 Oct 26 11:36:33.825257 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Role: member,reader Oct 26 11:36:33.825257 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Roles: member,reader Oct 26 11:36:33.826995 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b78491741fc7450b932b7a43e5d3bb92", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b78491741fc7450b932b7a43e5d3bb92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b78491741fc7450b932b7a43e5d3bb92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b78491741fc7450b932b7a43e5d3bb92"}]}] Oct 26 11:36:33.826995 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant: tempest-AttachVolumeTestJSON-554587477 Oct 26 11:36:33.826995 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Id: b78491741fc7450b932b7a43e5d3bb92 Oct 26 11:36:33.826995 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Name: tempest-AttachVolumeTestJSON-554587477 Oct 26 11:36:33.826995 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User: tempest-AttachVolumeTestJSON-554587477-project Oct 26 11:36:33.826995 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Id: default Oct 26 11:36:33.826995 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Name: Default Oct 26 11:36:33.826995 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Id: 80087d6fbe284b02b20c64ce3237d3b5 Oct 26 11:36:33.826995 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Name: tempest-AttachVolumeTestJSON-554587477-project Oct 26 11:36:33.826995 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: method: > Oct 26 11:36:33.826995 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: exception: Instance c1c26fc3-f012-462e-baa2-fff8a703ff44 could not be found. Oct 26 11:36:33.826995 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: action_args: {'id': 'c1c26fc3-f012-462e-baa2-fff8a703ff44'} Oct 26 11:36:33.828012 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:36:33.828012 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:36:33.828012 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:36:33.828012 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:36:33.828012 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:36:33.828012 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:36:33.828012 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:36:33.828012 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:36:33.828012 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:36:33.828012 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:36:33.828012 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1c26fc3-f012-462e-baa2-fff8a703ff44 could not be found. Oct 26 11:36:33.828012 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:36:33.828012 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:36:33.828012 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:36:33.828012 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:36:33.828012 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:36:33.828012 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:36:33.828012 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:36:33.828012 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:36:33.828012 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:36:33.829627 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:36:33.829627 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 11:36:33.829627 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 11:36:33.829627 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:36:33.829627 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:36:33.829627 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:36:33.829627 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:36:33.829627 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1c26fc3-f012-462e-baa2-fff8a703ff44 could not be found. Oct 26 11:36:33.829627 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:36:33.829627 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:36:33.829627 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:36:33.829627 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:36:33.829627 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:36:33.829627 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:36:33.829627 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:36:33.829627 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:36:33.829627 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1c26fc3-f012-462e-baa2-fff8a703ff44 could not be found. Oct 26 11:36:33.829627 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:36:33.831155 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-8a06265b-6c28-4dcc-91d8-8b530c8e10f2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Returning 404 to user: Instance c1c26fc3-f012-462e-baa2-fff8a703ff44 could not be found. {{(pid=119306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:36:33.831155 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-8a06265b-6c28-4dcc-91d8-8b530c8e10f2 tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44" status: 404 len: 111 microversion: 2.1 time: 0.029925 Oct 26 11:36:33.831155 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 627/1244] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:36:33 2022] GET /compute/v2.1/servers/c1c26fc3-f012-462e-baa2-fff8a703ff44 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 26 11:36:35.081611 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-698cf9ab-514a-4c94-9b71-f03a4a36ebea tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:36:35.082115 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.compute.api [None req-698cf9ab-514a-4c94-9b71-f03a4a36ebea tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119305) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:36:35.088575 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-698cf9ab-514a-4c94-9b71-f03a4a36ebea tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:35.089066 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-698cf9ab-514a-4c94-9b71-f03a4a36ebea tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:35.089536 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-698cf9ab-514a-4c94-9b71-f03a4a36ebea tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:35.090230 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-698cf9ab-514a-4c94-9b71-f03a4a36ebea tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:35.090689 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-698cf9ab-514a-4c94-9b71-f03a4a36ebea tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:35.091149 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG oslo_concurrency.lockutils [None req-698cf9ab-514a-4c94-9b71-f03a4a36ebea tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:35.104838 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.wsgi [None req-698cf9ab-514a-4c94-9b71-f03a4a36ebea tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] HTTP exception thrown: Instance bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 could not be found. Oct 26 11:36:35.106396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-698cf9ab-514a-4c94-9b71-f03a4a36ebea tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Request method failure captured: Oct 26 11:36:35.106396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: request: DELETE /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 HTTP/1.1 Oct 26 11:36:35.106396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept: application/json Oct 26 11:36:35.106396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Accept-Encoding: identity Oct 26 11:36:35.106396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Connection: close Oct 26 11:36:35.106396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Length: 0 Oct 26 11:36:35.106396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Content-Type: application/json Oct 26 11:36:35.106396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Host: 10.222.0.42 Oct 26 11:36:35.106396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: Openstack-System-Scope: None Oct 26 11:36:35.106396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: User-Agent: python-urllib3/1.26.12 Oct 26 11:36:35.106396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Auth-Token: gAAAAABjWRoWOVoEZSDq11o_WPUxBfBH5X1Tn0zByJ9tNdUyQnICBOpyLC5fja5T9eXSP4eNgIe-5a9uZ3V9VSOWodiW2qNxAqGTJl8udvJCT-0n8YZSK3WDSE2tnBNa9VavTFyxaQA9Gu7NcgrVm_xLJhjxds376v0Q-RhGOUhTfbEV8PcseGQ Oct 26 11:36:35.106396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Id: None Oct 26 11:36:35.106396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Domain-Name: None Oct 26 11:36:35.106396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Identity-Status: Confirmed Oct 26 11:36:35.106396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Is-Admin-Project: True Oct 26 11:36:35.106396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Id: default Oct 26 11:36:35.106396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Domain-Name: Default Oct 26 11:36:35.106396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Id: b78491741fc7450b932b7a43e5d3bb92 Oct 26 11:36:35.106396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Project-Name: tempest-AttachVolumeTestJSON-554587477 Oct 26 11:36:35.106396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Role: member,reader Oct 26 11:36:35.106396 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Roles: member,reader Oct 26 11:36:35.108183 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b78491741fc7450b932b7a43e5d3bb92", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b78491741fc7450b932b7a43e5d3bb92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b78491741fc7450b932b7a43e5d3bb92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b78491741fc7450b932b7a43e5d3bb92"}]}] Oct 26 11:36:35.108183 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant: tempest-AttachVolumeTestJSON-554587477 Oct 26 11:36:35.108183 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Id: b78491741fc7450b932b7a43e5d3bb92 Oct 26 11:36:35.108183 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-Tenant-Name: tempest-AttachVolumeTestJSON-554587477 Oct 26 11:36:35.108183 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User: tempest-AttachVolumeTestJSON-554587477-project Oct 26 11:36:35.108183 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Id: default Oct 26 11:36:35.108183 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Domain-Name: Default Oct 26 11:36:35.108183 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Id: 80087d6fbe284b02b20c64ce3237d3b5 Oct 26 11:36:35.108183 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: X-User-Name: tempest-AttachVolumeTestJSON-554587477-project Oct 26 11:36:35.108183 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: method: > Oct 26 11:36:35.108183 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: exception: Instance bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 could not be found. Oct 26 11:36:35.108183 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: action_args: {'id': 'bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3'} Oct 26 11:36:35.109310 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: {{(pid=119305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:36:35.109310 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:36:35.109310 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:36:35.109310 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:36:35.109310 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:36:35.109310 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:36:35.109310 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:36:35.109310 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:36:35.109310 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:36:35.109310 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:36:35.109310 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 could not be found. Oct 26 11:36:35.109310 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:36:35.109310 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:36:35.109310 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:36:35.109310 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:36:35.109310 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:36:35.109310 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:36:35.109310 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:36:35.109310 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:36:35.109310 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:36:35.111017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:36:35.111017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 26 11:36:35.111017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 26 11:36:35.111017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 26 11:36:35.111017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 26 11:36:35.111017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:36:35.111017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:36:35.111017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:36:35.111017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:36:35.111017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 could not be found. Oct 26 11:36:35.111017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:36:35.111017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:36:35.111017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:36:35.111017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:36:35.111017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:36:35.111017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:36:35.111017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:36:35.111017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:36:35.111017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 could not be found. Oct 26 11:36:35.111017 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: ERROR nova.api.openstack.wsgi Oct 26 11:36:35.112724 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: DEBUG nova.api.openstack.wsgi [None req-698cf9ab-514a-4c94-9b71-f03a4a36ebea tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Returning 404 to user: Instance bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 could not be found. {{(pid=119305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:36:35.112724 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: INFO nova.api.openstack.requestlog [None req-698cf9ab-514a-4c94-9b71-f03a4a36ebea tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 404 len: 111 microversion: 2.1 time: 0.030005 Oct 26 11:36:35.112724 dv-cinder-815582-18-iscsi devstack@n-api.service[119305]: [pid: 119305|app: 0|req: 618/1245] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Oct 26 11:36:35 2022] DELETE /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 26 11:36:35.116675 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-a733fa0e-c41e-4ba8-9fe0-b4f322fcaa2f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Calling method '>' {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 26 11:36:35.117292 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.compute.api [None req-a733fa0e-c41e-4ba8-9fe0-b4f322fcaa2f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] [instance: bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3] Fetching instance by UUID {{(pid=119306) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 26 11:36:35.123632 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a733fa0e-c41e-4ba8-9fe0-b4f322fcaa2f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:35.124115 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a733fa0e-c41e-4ba8-9fe0-b4f322fcaa2f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:35.124550 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a733fa0e-c41e-4ba8-9fe0-b4f322fcaa2f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:35.125243 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a733fa0e-c41e-4ba8-9fe0-b4f322fcaa2f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Acquiring lock "7411e83a-2967-480a-988d-f63e6d8f34bf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 26 11:36:35.125699 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a733fa0e-c41e-4ba8-9fe0-b4f322fcaa2f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 26 11:36:35.126126 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG oslo_concurrency.lockutils [None req-a733fa0e-c41e-4ba8-9fe0-b4f322fcaa2f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Lock "7411e83a-2967-480a-988d-f63e6d8f34bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 26 11:36:35.139132 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.wsgi [None req-a733fa0e-c41e-4ba8-9fe0-b4f322fcaa2f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] HTTP exception thrown: Instance bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 could not be found. Oct 26 11:36:35.140612 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-a733fa0e-c41e-4ba8-9fe0-b4f322fcaa2f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Request method failure captured: Oct 26 11:36:35.140612 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: request: GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 HTTP/1.1 Oct 26 11:36:35.140612 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept: application/json Oct 26 11:36:35.140612 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Accept-Encoding: identity Oct 26 11:36:35.140612 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Connection: close Oct 26 11:36:35.140612 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Length: 0 Oct 26 11:36:35.140612 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Content-Type: application/json Oct 26 11:36:35.140612 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Host: 10.222.0.42 Oct 26 11:36:35.140612 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: Openstack-System-Scope: None Oct 26 11:36:35.140612 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: User-Agent: python-urllib3/1.26.12 Oct 26 11:36:35.140612 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Auth-Token: gAAAAABjWRoWOVoEZSDq11o_WPUxBfBH5X1Tn0zByJ9tNdUyQnICBOpyLC5fja5T9eXSP4eNgIe-5a9uZ3V9VSOWodiW2qNxAqGTJl8udvJCT-0n8YZSK3WDSE2tnBNa9VavTFyxaQA9Gu7NcgrVm_xLJhjxds376v0Q-RhGOUhTfbEV8PcseGQ Oct 26 11:36:35.140612 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Id: None Oct 26 11:36:35.140612 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Domain-Name: None Oct 26 11:36:35.140612 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Identity-Status: Confirmed Oct 26 11:36:35.140612 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Is-Admin-Project: True Oct 26 11:36:35.140612 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Id: default Oct 26 11:36:35.140612 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Domain-Name: Default Oct 26 11:36:35.140612 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Id: b78491741fc7450b932b7a43e5d3bb92 Oct 26 11:36:35.140612 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Project-Name: tempest-AttachVolumeTestJSON-554587477 Oct 26 11:36:35.140612 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Role: member,reader Oct 26 11:36:35.140612 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Roles: member,reader Oct 26 11:36:35.142336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b78491741fc7450b932b7a43e5d3bb92", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b78491741fc7450b932b7a43e5d3bb92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b78491741fc7450b932b7a43e5d3bb92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b78491741fc7450b932b7a43e5d3bb92"}]}] Oct 26 11:36:35.142336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant: tempest-AttachVolumeTestJSON-554587477 Oct 26 11:36:35.142336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Id: b78491741fc7450b932b7a43e5d3bb92 Oct 26 11:36:35.142336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-Tenant-Name: tempest-AttachVolumeTestJSON-554587477 Oct 26 11:36:35.142336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User: tempest-AttachVolumeTestJSON-554587477-project Oct 26 11:36:35.142336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Id: default Oct 26 11:36:35.142336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Domain-Name: Default Oct 26 11:36:35.142336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Id: 80087d6fbe284b02b20c64ce3237d3b5 Oct 26 11:36:35.142336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: X-User-Name: tempest-AttachVolumeTestJSON-554587477-project Oct 26 11:36:35.142336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: method: > Oct 26 11:36:35.142336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: exception: Instance bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 could not be found. Oct 26 11:36:35.142336 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: action_args: {'id': 'bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3'} Oct 26 11:36:35.143353 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: {{(pid=119306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 26 11:36:35.143353 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:36:35.143353 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 26 11:36:35.143353 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 26 11:36:35.143353 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 26 11:36:35.143353 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 26 11:36:35.143353 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 26 11:36:35.143353 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 26 11:36:35.143353 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 26 11:36:35.143353 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 26 11:36:35.143353 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 could not be found. Oct 26 11:36:35.143353 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:36:35.143353 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:36:35.143353 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:36:35.143353 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:36:35.143353 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:36:35.143353 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:36:35.143353 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 26 11:36:35.143353 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 26 11:36:35.143353 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 26 11:36:35.145201 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 26 11:36:35.145201 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 26 11:36:35.145201 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 26 11:36:35.145201 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 26 11:36:35.145201 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 26 11:36:35.145201 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 26 11:36:35.145201 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 26 11:36:35.145201 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 could not be found. Oct 26 11:36:35.145201 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:36:35.145201 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 26 11:36:35.145201 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:36:35.145201 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 26 11:36:35.145201 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 26 11:36:35.145201 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 26 11:36:35.145201 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 26 11:36:35.145201 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 26 11:36:35.145201 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 could not be found. Oct 26 11:36:35.145201 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: ERROR nova.api.openstack.wsgi Oct 26 11:36:35.147327 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: DEBUG nova.api.openstack.wsgi [None req-a733fa0e-c41e-4ba8-9fe0-b4f322fcaa2f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] Returning 404 to user: Instance bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 could not be found. {{(pid=119306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 26 11:36:35.147327 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: INFO nova.api.openstack.requestlog [None req-a733fa0e-c41e-4ba8-9fe0-b4f322fcaa2f tempest-AttachVolumeTestJSON-554587477 tempest-AttachVolumeTestJSON-554587477-project] 10.222.0.42 "GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3" status: 404 len: 111 microversion: 2.1 time: 0.029856 Oct 26 11:36:35.147327 dv-cinder-815582-18-iscsi devstack@n-api.service[119306]: [pid: 119306|app: 0|req: 628/1246] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Oct 26 11:36:35 2022] GET /compute/v2.1/servers/bdc3f9a0-9776-4e4c-a27a-dcdbf18a67c3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)